-- Logs begin at Mon 2022-08-29 20:27:24 UTC, end at Mon 2022-08-29 21:51:56 UTC. -- Aug 29 21:17:37.313439 dv-cinder-854264-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:17:37.322148 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:17:37 2022] *** Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: nodename: dv-cinder-854264-2-iscsi Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: machine: x86_64 Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: clock source: unix Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: pcre jit disabled Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: detected number of CPU cores: 4 Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: current working directory: / Aug 29 21:17:37.324143 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:17:37.324840 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: your processes number limit is 47680 Aug 29 21:17:37.324840 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: your memory page size is 4096 bytes Aug 29 21:17:37.324840 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: detected max file descriptor number: 2048 Aug 29 21:17:37.324840 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: lock engine: pthread robust mutexes Aug 29 21:17:37.324840 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: thunder lock: enabled Aug 29 21:17:37.324840 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:17:37.324840 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:17:37.364049 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: Python main interpreter initialized at 0x5616137af9c0 Aug 29 21:17:37.364049 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: python threads support enabled Aug 29 21:17:37.364049 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: your server socket listen backlog is limited to 100 connections Aug 29 21:17:37.364049 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:17:37.364403 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:17:37.364500 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: *** Operational MODE: preforking *** Aug 29 21:17:37.364719 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:17:37.364719 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: spawned uWSGI master process (pid: 106325) Aug 29 21:17:37.364925 dv-cinder-854264-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:17:37.366350 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: spawned uWSGI worker 1 (pid: 106326, cores: 1) Aug 29 21:17:37.366350 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: spawned uWSGI worker 2 (pid: 106327, cores: 1) Aug 29 21:17:37.366350 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:17:38.030735 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:17:38.046362 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:17:39.131579 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:17:39.131579 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: from cryptography.utils import int_from_bytes Aug 29 21:17:39.132224 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:17:39.132224 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: from cryptography.utils import int_from_bytes Aug 29 21:17:39.133529 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:17:39.133529 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: from cryptography.utils import int_from_bytes Aug 29 21:17:39.133969 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:17:39.133969 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: from cryptography.utils import int_from_bytes Aug 29 21:17:41.630307 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:17:41.630958 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:17:41.631329 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:17:41.631427 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:17:41.631503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:17:41.631592 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:17:41.631693 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:17:41.631770 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:17:41.631846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:17:41.631950 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:17:41.632126 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.632230 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.632431 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.632551 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.632760 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.632856 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.633087 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.633183 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.633420 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.633519 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.633735 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.633822 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.634062 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.634150 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.634386 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.634491 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.634708 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.634800 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.634994 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.635085 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.635313 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.635408 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.635637 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-2-iscsi {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.635723 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-2-iscsi {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.635984 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.636168 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.636291 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.636546 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.636674 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.636910 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.637112 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.637533 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.637839 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.638164 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.638404 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.638569 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.638748 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.638944 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.640290 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.640429 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.640561 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.640705 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.640829 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.640964 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.641083 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.641227 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.641345 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.641483 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.641638 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.641770 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.641893 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642020 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642262 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642391 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642513 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642642 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642764 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.642887 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643016 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-2-iscsi {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643139 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643275 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643406 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-2-iscsi {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643529 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643650 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643777 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.643964 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.644085 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.644223 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.644444 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.644573 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.644698 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.644833 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.644957 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.645151 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.645277 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.645406 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.645539 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.645662 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.645802 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.645977 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.646104 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.646294 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.646438 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.646611 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.646748 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.646914 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.647042 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.647220 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.647371 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.647565 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.647690 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.647814 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.647968 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.648131 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.648260 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.648433 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.648568 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.648688 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.648809 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.648970 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.649133 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.649270 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.649394 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.649586 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.649714 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.649904 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.650038 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.650160 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.650283 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.650404 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.651063 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.651328 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.651457 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.651580 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.651931 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.652095 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.652267 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.652394 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.652585 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.652856 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.652983 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.653198 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.653325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.653511 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.653785 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.653920 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.654100 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.654253 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.654450 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.654617 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.654743 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.654864 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.655020 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.655169 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.655377 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.655511 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.655634 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.655755 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.655974 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.656104 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.656310 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.656459 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.656623 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.656723 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.656952 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.657043 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.657260 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.657364 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.657568 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.657652 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.657906 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.658005 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.658214 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.658301 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.658514 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.658600 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.658832 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.658973 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.659147 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.659273 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.659448 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.659574 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.659755 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.659927 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.660085 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.660212 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.660404 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.660555 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.660729 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.660855 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.660986 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.661110 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.661263 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.661397 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.661562 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.661689 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.661864 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.662000 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.662177 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.662321 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.662482 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.662609 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.662784 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.662926 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.663086 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.663220 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.663378 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.663506 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.663682 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.663815 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.664014 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.664146 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.664301 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.664429 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.664606 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.664739 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.664908 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.665040 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.665209 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.665356 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.665515 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.665643 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.665826 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.665955 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.666170 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.666871 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.667050 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.667177 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.667362 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.667498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.667735 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.667871 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.668026 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.668162 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.668294 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.668425 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.668607 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.668744 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.668919 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.669053 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.669231 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.669367 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.669541 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.669667 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.669857 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.669999 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.670170 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.670492 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.670629 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.670804 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.670940 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.671120 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.671254 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.671425 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.671566 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.671727 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.671854 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.672109 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.672236 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.672358 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.672479 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.672664 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.672789 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.672972 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.673101 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.673273 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.673398 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.673578 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.673714 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.673882 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.674011 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.674185 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.674313 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.674488 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.674622 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.674792 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.674918 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.675091 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.675228 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.675393 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.675529 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.675690 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.675818 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.676028 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.676170 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.676349 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.676485 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.676656 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.676783 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.676950 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.677086 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.677252 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.677388 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.677566 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:17:41.677694 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.677899 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.678047 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.678226 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.678362 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.678563 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.678691 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.678873 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.679000 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.679201 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.679330 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.679511 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.679638 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.679831 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.680003 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.680164 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.680292 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.680476 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.680610 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.680792 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.680917 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.681099 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.681232 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.681410 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.681538 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.681717 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.681853 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.682071 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.682218 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.682386 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.682513 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.682706 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.682839 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.683022 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.683148 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.683335 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.683475 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.683648 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.683774 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.684010 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.684138 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.684336 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.684476 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.684651 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.684791 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.684988 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.685114 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.685296 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.685423 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.685632 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.685768 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.685954 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.686087 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.686266 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.686393 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.686578 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.686719 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.686937 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.687100 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.687233 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.687361 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.687492 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.687625 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.687785 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.687958 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.688128 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.688255 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.688454 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.688582 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.688764 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.688891 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.689077 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.689252 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.689386 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.689511 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.689688 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.689815 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.689992 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.690126 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.690317 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.690450 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.690604 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.690732 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.690911 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.691068 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.691228 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.691353 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.691536 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.691663 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.691847 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.692011 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.692189 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.692315 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.692497 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.692635 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.692808 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.692944 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.693118 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.693244 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.693425 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.693560 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.693729 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.693864 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.694032 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.694418 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.694598 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.694744 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.694898 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.695103 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.695229 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.695352 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.695481 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.695604 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.695773 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.695964 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.696187 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.696322 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.696522 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.696649 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.696823 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.696950 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.697138 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.697271 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.697472 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.697602 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.697784 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.697913 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.698093 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.698220 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.698398 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.698524 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.698698 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.698834 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.699006 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.699133 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.699313 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.699440 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.699613 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.699750 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.699943 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.700073 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.700257 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.700400 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.700559 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.700688 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.700872 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.700999 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.701172 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.701317 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.701477 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.701605 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.701787 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.701916 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.702098 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.702236 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.702407 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.702527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.702718 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.702852 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.703029 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.703169 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.703341 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.703468 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.703648 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.703773 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.703978 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.704108 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.704313 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.704442 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.704635 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.704769 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.704935 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.705062 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.705252 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.705379 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.705564 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.705698 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.705872 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.705998 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.706171 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.706306 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.706475 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.706609 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.706771 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.706898 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.707071 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.707237 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.707369 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.707501 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.707660 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.707788 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.707988 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.708158 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.708282 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.708416 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.708591 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.708724 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.708917 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.709049 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.709218 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.709358 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.709522 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.709649 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.709828 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.709954 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.710126 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.710263 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.710425 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.710553 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.710725 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.710861 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.711062 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.711190 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.711364 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.711491 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.711703 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.711862 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.712059 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.712189 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.712375 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.712501 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.712689 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.712816 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.712998 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.713624 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.713841 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.713968 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.714148 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.714273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.714456 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.714589 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.714764 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.714893 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.715072 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.715207 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.715390 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.715516 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.715705 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.715840 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.716058 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.716199 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.716375 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.716509 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.716690 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.716815 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.716995 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.717130 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.717293 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.717418 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.717595 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.717724 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.717908 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.718051 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.718244 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.718373 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.718571 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.718697 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.718880 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.719014 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.719194 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.719320 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.719499 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.719626 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.719809 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.719994 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.720131 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.720254 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.720432 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.720559 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.720738 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.720873 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.721043 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.721171 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.721357 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.721484 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.721663 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.721798 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.721974 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.722101 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.722281 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.722408 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.722599 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.722717 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.722902 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.723034 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.723213 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.723350 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.723514 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.723647 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.723856 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.724011 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.724195 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.724401 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.724534 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.724666 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.724822 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.724957 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.725128 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.725266 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.725436 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.725561 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.725742 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.725867 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.726045 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.726178 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.726351 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.726477 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.726655 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.726795 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.726957 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.727084 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.727263 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.727436 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.727571 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.727692 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.727864 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.728030 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.728194 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.728319 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.728495 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.728635 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.729362 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.729673 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.729800 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.729987 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.730112 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.730291 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.730413 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.730593 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.730733 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.730901 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.731030 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.731258 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.731395 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.731556 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.731683 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.731862 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.732023 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.732200 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.732326 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.732512 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.732625 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.732821 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.732956 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.733127 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.733255 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.733431 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.733558 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.733758 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.733883 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.734058 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.734186 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.734356 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.734483 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.734674 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.734806 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.734989 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.735115 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.735298 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.735436 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.735607 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.735742 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.735945 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.736078 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.736258 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.736383 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.736571 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.736711 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.736882 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.737011 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.737194 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.737322 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.737491 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.737624 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.737806 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.737932 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.738114 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.738238 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.738426 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.738565 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.738736 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.738861 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.739044 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.739169 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.739354 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.739479 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.739670 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.739794 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.740000 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.740138 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.740313 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.740455 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.740628 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.740775 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.740927 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.741235 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.741374 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.741553 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.741678 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.741886 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.742119 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.742247 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.742449 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.742575 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.742763 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.742888 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.743081 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.743226 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.743397 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.743533 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.743741 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.743880 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.744099 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.744232 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.744427 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.744554 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.744735 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.744862 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.745032 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.745157 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.745337 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.745473 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.745620 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.745789 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.745915 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.746037 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.746217 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.746352 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.746519 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.746646 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.746818 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.746945 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.747117 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.747259 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.747419 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.747594 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.747720 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.747840 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.748019 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.748162 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.748398 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.748525 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.748701 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.748828 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.749008 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.749218 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.749351 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.749482 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.749607 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.749729 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.749884 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.750013 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.750203 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.750329 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.750507 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.750633 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.750805 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.750931 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.751103 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.751230 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.751402 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.751530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.751737 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.751874 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.752076 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.752204 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.752416 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.752595 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.752730 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.752854 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.753052 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.753178 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.753348 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.753487 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.753648 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.753776 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.753951 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.754076 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.754274 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.754416 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.754540 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.754661 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.754827 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.754954 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.755134 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.755270 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.755440 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.755569 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.755739 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.755867 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.756056 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.756189 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.756365 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.756493 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.756674 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.756801 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.756976 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.757102 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.757278 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.757410 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.757624 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.757761 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.757894 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.758018 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.758176 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.758303 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.758475 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.758608 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.758775 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.758909 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.759072 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.759200 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.759380 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.759515 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.759681 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.759806 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.760018 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.760148 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.760329 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.760466 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.760628 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.760756 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.760930 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.761057 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.761228 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.761362 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.761526 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.761654 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.761825 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.761964 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.762132 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.762272 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.762439 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.762567 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.762738 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.762865 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.763042 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.763169 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.763352 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.763477 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.763660 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.763798 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.763989 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.764119 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.764305 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.764433 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.764629 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.764754 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.764929 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.765057 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.765236 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.765366 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.765549 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.765675 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.765853 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.765978 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.766161 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.766289 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.766468 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.766608 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.766780 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.766914 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.767085 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.767213 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.767380 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.767518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.767708 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.767840 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768028 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768152 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768281 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768414 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768545 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768674 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768844 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.768986 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.769132 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.769265 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.769443 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.769571 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.769748 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.769875 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.770048 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.770184 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.770346 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.770475 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.770642 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.770769 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.770978 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.771106 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.771276 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.771403 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.771629 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.771772 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.771938 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.772065 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.772243 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.772370 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.772557 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.772686 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.772866 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.772994 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.773173 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.773301 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.773480 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.773608 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.773778 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.773908 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.774089 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.774216 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.774394 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.774558 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.774694 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.774824 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.774985 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.775112 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.775282 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.775418 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.776179 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.776309 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.776511 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.776631 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.776826 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.776965 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.777131 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.777257 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.777445 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.777569 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.777793 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778002 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778128 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778248 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778369 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778490 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778644 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778773 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.778952 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.779080 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.779258 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.779385 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.779567 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.779695 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.779877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.780022 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.780212 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.780339 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.780520 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.780651 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.780829 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.780952 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.781138 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.781253 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.781441 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.781564 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.781749 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.781869 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.782059 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.782183 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.782360 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.782475 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.782673 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.782800 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.782981 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.783126 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.783283 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.783410 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.783587 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.783712 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.783918 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.784063 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.784198 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.784364 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.784493 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.784684 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.784915 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.785051 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.785225 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.785352 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.785532 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.785660 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.785833 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.785962 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.786208 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.786334 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.786519 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.786646 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.786831 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.786958 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.787187 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.787318 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.787441 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.787570 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.787880 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.788027 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.788178 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.788319 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.788482 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.788608 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.788792 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.788919 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.789093 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.789222 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.789395 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.789532 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.789700 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.789826 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.790009 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.790137 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.790308 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.790444 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.790611 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.790738 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.790911 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.791040 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.791283 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.791951 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.792111 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.792239 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.792433 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.792606 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.792849 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.792987 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.793160 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.793288 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.793462 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.793590 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.793857 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.793984 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.794183 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.794310 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.794511 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.794655 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.794823 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.794951 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.795142 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.795271 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.795460 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.795587 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.795758 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.795907 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.796094 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.796224 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.796405 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.796533 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.796725 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.796846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.797040 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.797173 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.797350 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.797482 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.797678 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.797808 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.797980 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.798107 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.798305 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.798434 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.798648 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.798789 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.798959 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.799090 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.799275 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.799404 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.799641 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.799776 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.799997 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.800129 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.800305 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.800432 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.800611 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.800751 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.800928 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.801064 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.801226 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.801353 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.801525 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.801663 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.801835 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.801973 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.802138 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.802266 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.802438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.802567 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.802750 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.802877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.803047 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.803167 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.803354 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.803483 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.803657 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.803822 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.803975 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.804112 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.804272 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.804402 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.804574 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.804703 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.804892 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.805021 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.805192 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.805321 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.805508 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.805636 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.805817 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.805954 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.806137 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.806266 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.806456 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.806584 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.806772 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.806917 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.807088 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.807216 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.807393 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.807520 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.807699 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.807836 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.808061 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.808191 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.808315 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.808438 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.808632 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.808772 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.808934 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.809094 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.809284 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.809413 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.809634 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.809763 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.809969 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.810097 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.810288 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.810423 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.810610 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.810738 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.810930 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.811057 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.811245 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.811373 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.811555 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.811684 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.811873 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.812019 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.812203 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.812339 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.812506 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.812629 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.812813 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.812927 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.813113 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.813235 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.813580 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.813722 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.813849 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.813972 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.814095 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.814228 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.814352 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.814475 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.814599 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.814721 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.814867 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.815009 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.815187 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.815324 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.815489 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.815620 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.815809 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.815969 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.816141 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.816270 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.816447 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.816576 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.816749 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.816886 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.817050 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.817178 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.817389 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.817511 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.817686 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.817814 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.818009 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.818174 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.818322 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.818450 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.818640 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.818768 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.818952 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.819078 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.819528 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.819658 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.819843 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.819991 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.820182 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.820323 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.820497 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.820633 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.820811 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.820933 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.821127 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.821250 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.821436 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.821561 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.821751 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.821995 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.822116 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.822333 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.822592 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.822729 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.822927 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.823057 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.823258 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.823396 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.823576 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.823706 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.823972 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.824105 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.824229 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.824353 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.824528 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.824657 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.824843 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.824971 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.825696 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.825854 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.826073 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.826205 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.826329 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.826453 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.826575 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.826698 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.826873 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827008 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827133 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827248 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827380 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827512 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827633 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827757 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.827879 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828026 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828151 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828342 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828468 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828590 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828712 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828843 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.828985 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.829116 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.829244 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.829366 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.829548 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.829677 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.829865 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.829994 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.830180 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.830318 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.830489 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.830629 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.830800 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.830937 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.831109 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.831237 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.831430 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.831564 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.831712 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.831842 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.832045 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.832200 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.832357 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.832568 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.832702 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.832827 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.832963 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.833087 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.833269 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.833414 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.833600 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.833728 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.833919 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.834047 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.834231 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.834482 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.834612 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.834806 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.834936 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.835145 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.835345 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.835482 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.835662 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.835790 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.836016 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.836147 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.836340 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.836470 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.836660 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.836788 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.836976 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.837117 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.837291 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.837420 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.837619 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.837741 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.837922 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.838685 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.838817 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.838939 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.839061 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.839184 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.839336 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.839473 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.839636 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.839777 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.839980 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.840121 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.840298 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.840437 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.840665 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.840836 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.840991 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.841190 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.841328 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.841516 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.841825 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.841963 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.842158 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.842284 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.842472 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.842603 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.842780 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.842907 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.843102 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.843228 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.843409 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.843536 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.843710 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.843837 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.844053 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.844212 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.844352 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.844476 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.844644 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.844773 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.844954 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.845094 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.845271 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.845400 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.845585 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.845717 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.845892 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.846027 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.846204 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.846330 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.846512 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.846641 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.846842 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.846979 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.847151 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.847280 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.847459 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.847593 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.847767 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.847919 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.848111 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.848251 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.848419 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.848546 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.848718 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.848844 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.849018 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.849145 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.849323 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.849450 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.849626 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.849774 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.849942 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.850076 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.850202 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.850324 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.850506 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.850636 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.850805 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.850933 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.851112 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.851239 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.851411 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.851538 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.851719 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.851847 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.852043 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.852189 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.852353 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.852481 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.852694 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.852820 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.853010 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.853146 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.853313 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.853442 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.853614 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.853791 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.854503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.854644 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.854805 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.854936 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.855149 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.855276 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.855457 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.855594 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.855765 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.856041 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.856173 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.856381 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.856524 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.856706 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.856960 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.857092 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.857291 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.857406 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.857610 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.857744 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.857940 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.858081 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.858247 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.858373 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.858579 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.858717 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.858899 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.859028 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.859200 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.859329 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.859517 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.859648 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.859837 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.860050 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.860184 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.860322 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.860489 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.860618 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.860804 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.860934 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.861121 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.861258 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.861426 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.861554 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.861737 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.861867 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.862046 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.862188 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.862357 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.862484 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.862664 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.862783 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.862981 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.863107 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.863266 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.863396 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.863575 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.863704 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.863897 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.864030 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.864216 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.864345 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.864560 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.864695 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.864876 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.865004 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.865186 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.865315 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.865500 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.865636 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.865810 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.865939 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.866114 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.866254 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.866438 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.866591 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.866763 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.866890 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.867071 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.867208 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.867376 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.867512 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.867701 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.867829 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.868036 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.868166 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.868344 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.868475 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.868765 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.868944 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.869110 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.869237 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.869394 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.869519 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.869709 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.869838 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.870019 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.870148 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.870337 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.870475 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.870654 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.870783 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.870962 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.871100 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.871284 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.871413 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.871595 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.871724 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.871951 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.872096 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.872265 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.872393 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.872575 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.872741 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.872868 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.873002 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.873187 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.873319 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.873509 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.873645 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.873823 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.873953 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.874128 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.874265 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.874434 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.874564 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.874747 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.874874 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.875047 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.875182 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.875346 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.875475 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.875650 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.875777 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.875953 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.876089 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.876260 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.876390 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.876560 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.876697 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.876860 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.876988 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.877164 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.877300 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.877461 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.877590 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.877749 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.877875 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.878052 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.878185 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.878366 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.878501 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.878652 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.878780 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.878981 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.879125 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.879259 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.879384 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.879537 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.879666 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.879837 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.880001 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.880160 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.880297 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.880509 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.880645 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.880779 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.880904 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.881070 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.881206 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.881398 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.881527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.881709 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.881839 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.882027 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.882156 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.882335 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.882464 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.882652 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.882790 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.882958 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.883123 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.883260 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.883386 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.883574 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.883705 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.883929 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.884062 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.884211 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.884356 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.884529 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.884663 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.884839 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.884987 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.885171 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.885313 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.885480 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.885616 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.885788 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.885925 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.886097 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.886238 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.886406 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.886536 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.886732 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.886860 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.887052 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.887179 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.887388 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.887505 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.887691 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.887823 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.888033 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.888163 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.888368 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.888497 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.888685 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.888817 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.888994 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.889170 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.889319 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.889457 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.889629 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.889770 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.889936 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.890073 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.890246 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.890373 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.890554 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.890700 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.890862 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.890990 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.891175 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.891304 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.891481 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.891686 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.891813 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.891990 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.892116 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.892238 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.892412 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.892547 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.892734 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.892862 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.893057 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.893186 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.893367 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.893495 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.893689 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.893817 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.894011 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.894139 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.894357 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.894485 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.894667 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.894787 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.894980 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.895107 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.895288 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.895417 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.895539 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:17:41.895662 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.895924 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.896228 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:17:41.896469 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:17:42.049820 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO dbcounter [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Registered counter for database nova_api Aug 29 21:17:42.052662 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO dbcounter [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Registered counter for database nova_api Aug 29 21:17:42.070350 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.074006 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_db.sqlalchemy.engines [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.077766 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.081353 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writer thread running {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.134015 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.context [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d54c4588-655f-44d3-a4d7-897122969839(cell1) {{(pid=106327) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:17:42.138248 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.context [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d54c4588-655f-44d3-a4d7-897122969839(cell1) {{(pid=106326) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:17:42.138407 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:17:42.138826 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:17:42.140453 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:17:42.141192 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:17:42.141642 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:17:42.142061 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_concurrency.lockutils [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:17:42.142524 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_concurrency.lockutils [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:17:42.143644 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:17:42.144124 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_concurrency.lockutils [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:17:42.144914 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_concurrency.lockutils [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:17:42.145362 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_concurrency.lockutils [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:17:42.145660 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO dbcounter [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Registered counter for database nova_cell0 Aug 29 21:17:42.147340 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_concurrency.lockutils [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:17:42.149334 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO dbcounter [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Registered counter for database nova_cell0 Aug 29 21:17:42.151527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO dbcounter [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Registered counter for database nova_cell1 Aug 29 21:17:42.153839 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO dbcounter [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Registered counter for database nova_cell1 Aug 29 21:17:42.159319 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.161673 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.163187 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_db.sqlalchemy.engines [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.164849 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_db.sqlalchemy.engines [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.166317 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.170340 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writer thread running {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.173063 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writer thread running {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.306252 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.317143 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO dbcounter [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Registered counter for database nova_cell0 Aug 29 21:17:42.317740 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO dbcounter [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Registered counter for database nova_cell0 Aug 29 21:17:42.325103 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_db.sqlalchemy.engines [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.328505 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG oslo_db.sqlalchemy.engines [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:17:42.329601 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writer thread running {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.333180 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writer thread running {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:17:42.769450 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:17:42.777382 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:17:42.806741 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: WARNING keystonemiddleware.auth_token [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:17:42.814263 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: WARNING keystonemiddleware.auth_token [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:17:43.120038 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:17:43.126176 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: WARNING keystonemiddleware.auth_token [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:17:43.131466 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616137af9c0 pid: 106327 (default app) Aug 29 21:17:43.133625 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:17:43.134849 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001810 Aug 29 21:17:43.135849 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Mon Aug 29 21:17:43 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:17:43.163076 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: WARNING keystonemiddleware.auth_token [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:17:43.169384 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: WARNING keystonemiddleware.auth_token [None req-6e7985d8-2316-411b-9f34-c3a173fc9b3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:17:43.174791 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616137af9c0 pid: 106326 (default app) Aug 29 21:19:07.284497 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:07.302468 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Aug 29 21:19:07.302468 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:07.302695 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writing DB stats nova_api:SELECT=3 {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:07.302695 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writing DB stats nova_cell0:SELECT=3 {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:07.302695 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writing DB stats nova_cell1:SELECT=3 {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:07.302695 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:08.216433 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-99735a5b-8327-4c16-a37d-83d2f8951747 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:08.257705 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-99735a5b-8327-4c16-a37d-83d2f8951747 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.964642 Aug 29 21:19:08.258543 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Aug 29 21:19:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:19:10.642628 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:10.643523 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-a8f8ff1d-1356-4b61-932d-08e56714fe22 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 29 21:19:10.656032 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:11.092950 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-aff57eb9-27be-4061-b3b1-0ce9e0814e74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "swap": 0, "disk": 1}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:11.208555 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-aff57eb9-27be-4061-b3b1-0ce9e0814e74 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.557629 Aug 29 21:19:11.209315 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:19:11.224198 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=3 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:11.225772 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell0:SELECT=3 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:11.227541 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell1:SELECT=3 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:11.229655 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:11.444203 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-eefd094b-fe83-43aa-a318-778a236567ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:11.643798 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-eefd094b-fe83-43aa-a318-778a236567ca admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.425731 Aug 29 21:19:11.644765 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Aug 29 21:19:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:14.122146 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-aff57eb9-27be-4061-b3b1-0ce9e0814e74 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:14.124001 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-aff57eb9-27be-4061-b3b1-0ce9e0814e74 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002264 Aug 29 21:19:14.124679 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:14.847382 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-1848c140-e3f7-447e-8cd6-22b1194cfa89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:14.969450 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-1848c140-e3f7-447e-8cd6-22b1194cfa89 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.834439 Aug 29 21:19:14.969921 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:19:14.982292 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-9648b7f8-4a07-4383-93b5-d5046382a5c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:15.103667 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-9648b7f8-4a07-4383-93b5-d5046382a5c1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125306 Aug 29 21:19:15.115942 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Aug 29 21:19:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:17.556596 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-1848c140-e3f7-447e-8cd6-22b1194cfa89 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:17.557626 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-1848c140-e3f7-447e-8cd6-22b1194cfa89 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 29 21:19:17.558563 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:17.968904 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-c615f226-e814-4988-83bc-f073e4c04525 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "id": "d2"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:18.053521 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-c615f226-e814-4988-83bc-f073e4c04525 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488014 Aug 29 21:19:18.053970 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:19:18.067377 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-571647f5-11e8-4e64-93f5-1b2411100ccc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:18.148571 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-571647f5-11e8-4e64-93f5-1b2411100ccc admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084881 Aug 29 21:19:18.159976 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Aug 29 21:19:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:20.547183 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-c615f226-e814-4988-83bc-f073e4c04525 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:20.548252 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-c615f226-e814-4988-83bc-f073e4c04525 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 29 21:19:20.548658 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:21.076431 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-eeb0b627-90af-4efb-943c-ecfc447058d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "id": "d3", "ram": 2048}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:21.203069 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-eeb0b627-90af-4efb-943c-ecfc447058d4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.645920 Aug 29 21:19:21.203411 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:19:21.216550 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-74951c62-956a-4081-a749-e3759cb710f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:21.361827 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-74951c62-956a-4081-a749-e3759cb710f6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149576 Aug 29 21:19:21.362628 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Aug 29 21:19:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:23.750263 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-eeb0b627-90af-4efb-943c-ecfc447058d4 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:23.751854 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-eeb0b627-90af-4efb-943c-ecfc447058d4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Aug 29 21:19:23.752726 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:24.197278 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-ad669a1b-e8be-42d5-a62c-81547fce1f51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:24.317043 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-ad669a1b-e8be-42d5-a62c-81547fce1f51 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557926 Aug 29 21:19:24.317561 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:19:24.330853 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-eecdf960-fdf1-4f3d-9e48-085cd3bcca06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:24.441410 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-eecdf960-fdf1-4f3d-9e48-085cd3bcca06 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114535 Aug 29 21:19:24.441989 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Aug 29 21:19:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:26.897585 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-ad669a1b-e8be-42d5-a62c-81547fce1f51 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:26.898697 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-ad669a1b-e8be-42d5-a62c-81547fce1f51 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 29 21:19:26.899074 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:19:27.371414 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9317b62f-f5cb-4894-a27c-9e68fa5a7fdb admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:27.405085 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-9317b62f-f5cb-4894-a27c-9e68fa5a7fdb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.498964 Aug 29 21:19:27.405781 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Aug 29 21:19:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:19:29.817435 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-ad669a1b-e8be-42d5-a62c-81547fce1f51 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:29.818367 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-ad669a1b-e8be-42d5-a62c-81547fce1f51 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 21:19:29.818765 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:30.262378 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-343b35cf-71d7-452c-af3c-b0b3d06665c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:30.340292 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-343b35cf-71d7-452c-af3c-b0b3d06665c9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.513526 Aug 29 21:19:30.340854 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:19:30.354530 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-3fcca749-8d3d-48ce-97a9-af3431d24a4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:30.453061 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-3fcca749-8d3d-48ce-97a9-af3431d24a4a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102401 Aug 29 21:19:30.453643 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Aug 29 21:19:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:32.802182 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-343b35cf-71d7-452c-af3c-b0b3d06665c9 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:32.804239 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-343b35cf-71d7-452c-af3c-b0b3d06665c9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001921 Aug 29 21:19:32.804239 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:33.198782 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-c83a298e-8c2b-4961-8a3a-1836f842e431 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:33.284974 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-c83a298e-8c2b-4961-8a3a-1836f842e431 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474223 Aug 29 21:19:33.285541 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:19:33.297523 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-8deb1f0b-2499-43d4-92c3-d01ebd963051 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:33.389644 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-8deb1f0b-2499-43d4-92c3-d01ebd963051 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095679 Aug 29 21:19:33.390320 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Aug 29 21:19:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:35.754648 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-c83a298e-8c2b-4961-8a3a-1836f842e431 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:35.755675 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-c83a298e-8c2b-4961-8a3a-1836f842e431 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 29 21:19:35.756116 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:36.277692 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-6ff7424f-c56c-43c3-b0d4-68db9c49de81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "name": "m1.medium", "ram": 4096}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:36.859379 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-6ff7424f-c56c-43c3-b0d4-68db9c49de81 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.096804 Aug 29 21:19:36.859947 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:19:36.874348 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-0a1e2a82-e585-40bd-b9cf-b956c7192e10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:37.069596 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-0a1e2a82-e585-40bd-b9cf-b956c7192e10 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.201102 Aug 29 21:19:37.070507 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Aug 29 21:19:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:39.498779 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-6ff7424f-c56c-43c3-b0d4-68db9c49de81 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:39.499768 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-6ff7424f-c56c-43c3-b0d4-68db9c49de81 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 29 21:19:39.500233 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:19:39.968546 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-fa85bf45-d155-4a84-ad90-c5d4a5f8e339 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:39.974663 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:19:40.071369 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-fa85bf45-d155-4a84-ad90-c5d4a5f8e339 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.564898 Aug 29 21:19:40.075962 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:19:40.086460 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-14d92956-7f7b-4f05-96e5-6a82f5cf39ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:40.190346 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-14d92956-7f7b-4f05-96e5-6a82f5cf39ed admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107449 Aug 29 21:19:40.191171 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Aug 29 21:19:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:19:42.725675 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-fa85bf45-d155-4a84-ad90-c5d4a5f8e339 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:19:42.726612 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-fa85bf45-d155-4a84-ad90-c5d4a5f8e339 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 29 21:19:42.727256 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:19:43.195307 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9dbc4be1-e6c7-49b0-affd-b75faf5db485 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "vcpus": 8, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:43.289982 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-9dbc4be1-e6c7-49b0-affd-b75faf5db485 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.556267 Aug 29 21:19:43.291118 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Aug 29 21:19:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:19:43.305759 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-3c053947-03a1-48d6-b45e-ac9f809a6e25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:19:43.410259 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-3c053947-03a1-48d6-b45e-ac9f809a6e25 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108275 Aug 29 21:19:43.411042 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Aug 29 21:19:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:20:02.500784 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9dbc4be1-e6c7-49b0-affd-b75faf5db485 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:02.501833 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-9dbc4be1-e6c7-49b0-affd-b75faf5db485 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 29 21:20:02.502240 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:02.903085 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-e36ad157-dc95-4d80-b442-91f5dbd259c2 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:02.924334 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-e36ad157-dc95-4d80-b442-91f5dbd259c2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415519 Aug 29 21:20:02.925094 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Aug 29 21:20:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:20:03.995562 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9dbc4be1-e6c7-49b0-affd-b75faf5db485 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:03.996594 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-9dbc4be1-e6c7-49b0-affd-b75faf5db485 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 29 21:20:03.996989 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:04.525326 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f9529cba-1073-44c9-ade0-318def4964d9 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:04.530919 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.wsgi [None req-f9529cba-1073-44c9-ade0-318def4964d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f9529cba-1073-44c9-ade0-318def4964d9 admin admin] Request method failure captured: Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Accept: application/json Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Accept-Encoding: gzip, deflate Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Connection: keep-alive Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Content-Length: 0 Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Host: 10.222.0.65 Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Openstack-Api-Version: compute 2.90 Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Openstack-System-Scope: None Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: User-Agent: python-novaclient Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Auth-Token: gAAAAABjDS2D5ifnAvukbfTGYBKpuDP1mmcMSy9TwX3b8WSqmfNxnAiJ9eSZfA3Y6_TRf342rvyr5SvHbDoZ5s8uy7Y7L-rnAWqtuM1YhGA0ICpYTE48A6v1fCDb0IK6x7roCm2qOJYAM5gSTOvaAJpE14ILQpjDqx-M4L7oATCw6RTVeQ2mPA0 Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Domain-Id: None Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Domain-Name: None Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Identity-Status: Confirmed Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Is-Admin-Project: True Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Domain-Id: default Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Domain-Name: Default Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Name: admin Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Role: member,reader,admin Aug 29 21:20:04.534223 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Roles: member,reader,admin Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_eb1de965aba54ca98b770d7165c4b67e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant: admin Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant-Name: admin Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User: admin Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Domain-Id: default Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Domain-Name: Default Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Id: 6fd5eb0c7a1f4bdbb078438d56380575 Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Name: admin Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: method: > Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: exception: Flavor 42 could not be found. Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: action_args: {'id': '42'} Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:20:04.541359 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:04.542325 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.543714 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f9529cba-1073-44c9-ade0-318def4964d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:20:04.545041 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-f9529cba-1073-44c9-ade0-318def4964d9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401316 Aug 29 21:20:04.545041 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Aug 29 21:20:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:20:04.545244 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-04b03fc9-48c4-4759-93bd-dc5002644d53 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:04.557197 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:20:04.568041 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-04b03fc9-48c4-4759-93bd-dc5002644d53 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026293 Aug 29 21:20:04.568588 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Aug 29 21:20:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:20:04.579191 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-66cf1925-aa4f-4717-b43b-04329784f7e2 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:04.601743 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-66cf1925-aa4f-4717-b43b-04329784f7e2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026080 Aug 29 21:20:04.602300 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Aug 29 21:20:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:20:04.612827 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d4802ebe-bc7d-4ea4-8df5-2a61f192b44b admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:04.618569 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.wsgi [None req-d4802ebe-bc7d-4ea4-8df5-2a61f192b44b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d4802ebe-bc7d-4ea4-8df5-2a61f192b44b admin admin] Request method failure captured: Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Accept: application/json Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Accept-Encoding: gzip, deflate Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Connection: keep-alive Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Content-Length: 0 Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Host: 10.222.0.65 Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Openstack-Api-Version: compute 2.90 Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Openstack-System-Scope: None Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: User-Agent: python-novaclient Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Auth-Token: gAAAAABjDS2D5ifnAvukbfTGYBKpuDP1mmcMSy9TwX3b8WSqmfNxnAiJ9eSZfA3Y6_TRf342rvyr5SvHbDoZ5s8uy7Y7L-rnAWqtuM1YhGA0ICpYTE48A6v1fCDb0IK6x7roCm2qOJYAM5gSTOvaAJpE14ILQpjDqx-M4L7oATCw6RTVeQ2mPA0 Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Domain-Id: None Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Domain-Name: None Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Identity-Status: Confirmed Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Is-Admin-Project: True Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Domain-Id: default Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Domain-Name: Default Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Name: admin Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Role: member,reader,admin Aug 29 21:20:04.622503 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Roles: member,reader,admin Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_eb1de965aba54ca98b770d7165c4b67e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant: admin Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant-Name: admin Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User: admin Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Domain-Id: default Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Domain-Name: Default Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Id: 6fd5eb0c7a1f4bdbb078438d56380575 Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Name: admin Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: method: > Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: exception: Flavor 42 could not be found. Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: action_args: {'id': '42'} Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:20:04.628882 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:04.629846 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:04.631141 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d4802ebe-bc7d-4ea4-8df5-2a61f192b44b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:20:04.632426 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-d4802ebe-bc7d-4ea4-8df5-2a61f192b44b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015111 Aug 29 21:20:04.632426 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Aug 29 21:20:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:20:05.612785 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-66cf1925-aa4f-4717-b43b-04329784f7e2 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:05.613813 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-66cf1925-aa4f-4717-b43b-04329784f7e2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Aug 29 21:20:05.614207 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:06.273545 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-81672552-8d47-4d4d-aa66-a8ef521356b7 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:06.279045 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.wsgi [None req-81672552-8d47-4d4d-aa66-a8ef521356b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-81672552-8d47-4d4d-aa66-a8ef521356b7 admin admin] Request method failure captured: Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Accept: application/json Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Accept-Encoding: gzip, deflate Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Connection: keep-alive Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Content-Length: 0 Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Host: 10.222.0.65 Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Openstack-Api-Version: compute 2.90 Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Openstack-System-Scope: None Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: User-Agent: python-novaclient Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Auth-Token: gAAAAABjDS2FvXohaOwRTDQNE3qLNrv_xs_HypWCEq2M4HyXEJUbpOU3aY8X5fSCWQl-60hDmx9tNkXFoTmZ60tvSp6SMVIGZhOlFJnKFK1D3_3yDL4JSJl2e5bd3eolQOr5sDoCfWV_dfreQxtpU7TWRVqFtClzePxU50WzQc_sZMkNZTYVKu0 Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Domain-Id: None Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Domain-Name: None Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Identity-Status: Confirmed Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Is-Admin-Project: True Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Domain-Id: default Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Domain-Name: Default Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Name: admin Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Role: member,reader,admin Aug 29 21:20:06.280530 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Roles: member,reader,admin Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_eb1de965aba54ca98b770d7165c4b67e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant: admin Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant-Name: admin Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User: admin Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Domain-Id: default Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Domain-Name: Default Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Id: 6fd5eb0c7a1f4bdbb078438d56380575 Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Name: admin Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: method: > Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: exception: Flavor 84 could not be found. Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: action_args: {'id': '84'} Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:20:06.282332 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:06.283211 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.284340 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-81672552-8d47-4d4d-aa66-a8ef521356b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:20:06.285445 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-81672552-8d47-4d4d-aa66-a8ef521356b7 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.533058 Aug 29 21:20:06.285445 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Aug 29 21:20:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:20:06.292157 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-297fc04d-81a7-4ea2-b5dc-f9382c4afa40 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:06.307752 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-297fc04d-81a7-4ea2-b5dc-f9382c4afa40 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019110 Aug 29 21:20:06.308330 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Aug 29 21:20:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:20:06.317899 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-a13ecfac-0f18-4308-8889-a1adffe91c9c admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:06.333985 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-a13ecfac-0f18-4308-8889-a1adffe91c9c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019798 Aug 29 21:20:06.334512 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Aug 29 21:20:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:20:06.344194 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-b2b45ddb-2606-4c1a-a7d6-ee1b6a8bc3cf admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:06.349769 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.wsgi [None req-b2b45ddb-2606-4c1a-a7d6-ee1b6a8bc3cf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-b2b45ddb-2606-4c1a-a7d6-ee1b6a8bc3cf admin admin] Request method failure captured: Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Accept: application/json Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Accept-Encoding: gzip, deflate Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Connection: keep-alive Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Content-Length: 0 Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Host: 10.222.0.65 Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Openstack-Api-Version: compute 2.90 Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Openstack-System-Scope: None Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: User-Agent: python-novaclient Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Auth-Token: gAAAAABjDS2FvXohaOwRTDQNE3qLNrv_xs_HypWCEq2M4HyXEJUbpOU3aY8X5fSCWQl-60hDmx9tNkXFoTmZ60tvSp6SMVIGZhOlFJnKFK1D3_3yDL4JSJl2e5bd3eolQOr5sDoCfWV_dfreQxtpU7TWRVqFtClzePxU50WzQc_sZMkNZTYVKu0 Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Domain-Id: None Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Domain-Name: None Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Identity-Status: Confirmed Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Is-Admin-Project: True Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Domain-Id: default Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Domain-Name: Default Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Name: admin Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Role: member,reader,admin Aug 29 21:20:06.351302 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Roles: member,reader,admin Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_eb1de965aba54ca98b770d7165c4b67e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant: admin Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant-Name: admin Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User: admin Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Domain-Id: default Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Domain-Name: Default Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Id: 6fd5eb0c7a1f4bdbb078438d56380575 Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Name: admin Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: method: > Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: exception: Flavor 84 could not be found. Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: action_args: {'id': '84'} Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:20:06.352877 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:06.354279 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:06.355438 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-b2b45ddb-2606-4c1a-a7d6-ee1b6a8bc3cf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:20:06.356489 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-b2b45ddb-2606-4c1a-a7d6-ee1b6a8bc3cf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012163 Aug 29 21:20:06.356489 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Aug 29 21:20:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:20:07.353422 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-a13ecfac-0f18-4308-8889-a1adffe91c9c admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:07.355191 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-a13ecfac-0f18-4308-8889-a1adffe91c9c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Aug 29 21:20:07.355573 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:07.914377 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-4a341909-90ff-46ed-8f41-c7d32bd0fdda admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:07.920636 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.wsgi [None req-4a341909-90ff-46ed-8f41-c7d32bd0fdda admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-4a341909-90ff-46ed-8f41-c7d32bd0fdda admin admin] Request method failure captured: Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Accept: application/json Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Accept-Encoding: gzip, deflate Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Connection: keep-alive Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Content-Length: 0 Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Host: 10.222.0.65 Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Openstack-Api-Version: compute 2.90 Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Openstack-System-Scope: None Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: User-Agent: python-novaclient Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Auth-Token: gAAAAABjDS2HzCLpNKz1IUXKjau4OKkrxelroyKVp6Oqs2GIKH7XxwCC-9GjelFC1ZcdVvkxqUf7seQ_6hENpO6_BaHzlAx7xe3PxG0LsHDNJMXp71VkhkZWakxCw7lBW_JJgieVwF1jsVaN-ACkQrvWzywFp4bopKjCtw2JcsR7y8sBFTCX2OQ Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Domain-Id: None Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Domain-Name: None Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Identity-Status: Confirmed Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Is-Admin-Project: True Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Domain-Id: default Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Domain-Name: Default Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Project-Name: admin Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Role: member,reader,admin Aug 29 21:20:07.922206 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Roles: member,reader,admin Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_eb1de965aba54ca98b770d7165c4b67e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant: admin Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-Tenant-Name: admin Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User: admin Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Domain-Id: default Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Domain-Name: Default Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Id: 6fd5eb0c7a1f4bdbb078438d56380575 Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: X-User-Name: admin Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: method: > Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: exception: Flavor 451 could not be found. Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: action_args: {'id': '451'} Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:20:07.923913 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:07.925015 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.926498 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-4a341909-90ff-46ed-8f41-c7d32bd0fdda admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:20:07.927823 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-4a341909-90ff-46ed-8f41-c7d32bd0fdda admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.423104 Aug 29 21:20:07.927823 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Aug 29 21:20:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:20:07.934099 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-80425bb5-8835-4912-ba9a-0493c882da1a admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:07.950520 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-80425bb5-8835-4912-ba9a-0493c882da1a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020448 Aug 29 21:20:07.951286 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Aug 29 21:20:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:20:07.961060 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:07.976216 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018784 Aug 29 21:20:07.976763 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Aug 29 21:20:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:20:07.986284 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d4a11d0d-2eab-40aa-bf19-d4bbeba0c1f8 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:07.991987 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.wsgi [None req-d4a11d0d-2eab-40aa-bf19-d4bbeba0c1f8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d4a11d0d-2eab-40aa-bf19-d4bbeba0c1f8 admin admin] Request method failure captured: Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Accept: application/json Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Accept-Encoding: gzip, deflate Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Connection: keep-alive Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Content-Length: 0 Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Host: 10.222.0.65 Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Openstack-Api-Version: compute 2.90 Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Openstack-System-Scope: None Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: User-Agent: python-novaclient Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Auth-Token: gAAAAABjDS2HzCLpNKz1IUXKjau4OKkrxelroyKVp6Oqs2GIKH7XxwCC-9GjelFC1ZcdVvkxqUf7seQ_6hENpO6_BaHzlAx7xe3PxG0LsHDNJMXp71VkhkZWakxCw7lBW_JJgieVwF1jsVaN-ACkQrvWzywFp4bopKjCtw2JcsR7y8sBFTCX2OQ Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Domain-Id: None Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Domain-Name: None Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Identity-Status: Confirmed Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Is-Admin-Project: True Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Domain-Id: default Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Domain-Name: Default Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Project-Name: admin Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Role: member,reader,admin Aug 29 21:20:07.993518 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Roles: member,reader,admin Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_eb1de965aba54ca98b770d7165c4b67e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/eb1de965aba54ca98b770d7165c4b67e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant: admin Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant-Id: eb1de965aba54ca98b770d7165c4b67e Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-Tenant-Name: admin Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User: admin Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Domain-Id: default Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Domain-Name: Default Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Id: 6fd5eb0c7a1f4bdbb078438d56380575 Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: X-User-Name: admin Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: method: > Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: exception: Flavor 451 could not be found. Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: action_args: {'id': '451'} Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:20:07.995405 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:07.996273 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: ERROR nova.api.openstack.wsgi Aug 29 21:20:07.997527 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d4a11d0d-2eab-40aa-bf19-d4bbeba0c1f8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:20:07.998537 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-d4a11d0d-2eab-40aa-bf19-d4bbeba0c1f8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012822 Aug 29 21:20:07.998537 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Aug 29 21:20:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 21:20:08.972575 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:08.973603 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 29 21:20:08.974007 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:09.528479 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-4b4f4f04-06cb-4fbb-a8ad-0082c28cc548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:20:09.608397 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-4b4f4f04-06cb-4fbb-a8ad-0082c28cc548 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.496620 Aug 29 21:20:09.608943 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Aug 29 21:20:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:20:10.582452 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:10.583499 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 29 21:20:10.583923 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:11.112644 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-515d537a-3f81-4a52-b6e3-440be2a97e83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:20:11.190739 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-515d537a-3f81-4a52-b6e3-440be2a97e83 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.469295 Aug 29 21:20:11.191296 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Aug 29 21:20:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:20:12.171832 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:12.172879 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 29 21:20:12.173283 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:12.701414 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-75f8c77a-476a-4d6d-918a-0c1db2e355c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:20:12.809537 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-75f8c77a-476a-4d6d-918a-0c1db2e355c5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.496875 Aug 29 21:20:12.810047 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Aug 29 21:20:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:20:13.796308 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:13.797394 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 29 21:20:13.797807 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:14.345922 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-2a579f86-ea97-49b6-879e-1aed4a517126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:20:14.473276 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-2a579f86-ea97-49b6-879e-1aed4a517126 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.535751 Aug 29 21:20:14.473754 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Aug 29 21:20:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:20:15.455874 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:15.456947 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 29 21:20:15.457345 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:20:16.000468 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-161594eb-e55d-4b6b-8963-c18621debcf7 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:20:16.021219 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-161594eb-e55d-4b6b-8963-c18621debcf7 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.427146 Aug 29 21:20:16.021726 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Mon Aug 29 21:20:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:21:10.972176 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:21:10.973207 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-36176eb7-31c9-4578-8b27-988f93747032 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Aug 29 21:21:10.973646 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 931 bytes} [Mon Aug 29 21:21:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:21:10.984473 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:11.389513 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-d9f7acad-59df-4e2f-aa1e-bfae1818f66d admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:21:11.410240 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-d9f7acad-59df-4e2f-aa1e-bfae1818f66d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430224 Aug 29 21:21:11.410792 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Aug 29 21:21:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:21:11.432778 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG dbcounter [-] [106326] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:21:11.436556 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-2bd1f2a1-8192-48f8-a3eb-bf005dbcf44f admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:21:11.444386 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-2bd1f2a1-8192-48f8-a3eb-bf005dbcf44f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013630 Aug 29 21:21:11.445054 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1283 bytes} [Mon Aug 29 21:21:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:21:11.457708 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-9858c2e8-5fa2-401f-b177-be18f536c92d admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:21:11.467470 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-9858c2e8-5fa2-401f-b177-be18f536c92d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013613 Aug 29 21:21:11.468062 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1286 bytes} [Mon Aug 29 21:21:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:21:11.480812 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:21:11.488921 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012441 Aug 29 21:21:11.490902 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1286 bytes} [Mon Aug 29 21:21:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:21:11.502095 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-8886ac4a-16c4-489e-b7ff-8efdd4a36198 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:21:11.510142 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-8886ac4a-16c4-489e-b7ff-8efdd4a36198 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011592 Aug 29 21:21:11.510628 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1283 bytes} [Mon Aug 29 21:21:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:24:30.705247 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:30.706328 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 29 21:24:30.707122 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:24:30.847313 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=6 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:31.015052 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:31.018570 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:31.019044 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:31.019468 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:31.021270 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:31.021270 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:31.021658 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:31.057061 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-da3c0f48-a95a-444d-87ef-ae2b09afbd25 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.211169 Aug 29 21:24:31.057637 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Aug 29 21:24:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:24:31.894980 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:31.896027 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 29 21:24:31.896434 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:24:32.092710 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:32.096315 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:32.096789 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:32.097218 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:32.097986 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:32.098432 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:32.098898 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:32.119124 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-be76eef0-c695-4241-9f96-5718d1d9ecaa admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079240 Aug 29 21:24:32.119693 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Aug 29 21:24:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:24:43.403579 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:43.404691 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 29 21:24:43.405091 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:24:43.559974 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell0:SELECT=4 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.560771 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_cell1:SELECT=4 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.561323 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG dbcounter [-] [106327] Writing DB stats nova_api:SELECT=8 {{(pid=106327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.612249 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:43.615706 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:43.616221 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:43.616644 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:43.617384 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:43.617823 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:43.618233 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:43.644198 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-26545e47-7f25-4f94-bd54-9d01e5144cd6 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088645 Aug 29 21:24:43.645362 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Aug 29 21:24:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:24:44.498717 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: DEBUG nova.api.openstack.wsgi [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] Calling method '>' {{(pid=106326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:44.499745 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: INFO nova.api.openstack.requestlog [None req-f0618247-625e-4875-89ab-e3307759625e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 29 21:24:44.500189 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: [pid: 106326|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Aug 29 21:24:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:24:44.700092 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG nova.api.openstack.wsgi [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] Calling method '>' {{(pid=106327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:44.703718 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:44.704164 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:44.704600 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:44.705329 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:44.705776 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:44.706192 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: DEBUG oslo_concurrency.lockutils [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:44.729492 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: INFO nova.api.openstack.requestlog [None req-082f8c90-11de-49bd-a55c-03d47bd1be14 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087735 Aug 29 21:24:44.730069 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: [pid: 106327|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Aug 29 21:24:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:25:43.354962 dv-cinder-854264-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 21:25:43.355659 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: Mon Aug 29 21:25:43 2022 - graceful shutdown triggered... Aug 29 21:25:43.356191 dv-cinder-854264-2-iscsi devstack@n-api.service[106326]: Gracefully killing worker 1 (pid: 106326)... Aug 29 21:25:43.356573 dv-cinder-854264-2-iscsi devstack@n-api.service[106327]: Gracefully killing worker 2 (pid: 106327)... Aug 29 21:25:44.356025 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: worker 1 buried after 1 seconds Aug 29 21:25:44.356551 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: worker 2 buried after 1 seconds Aug 29 21:25:44.356551 dv-cinder-854264-2-iscsi devstack@n-api.service[106325]: goodbye to uWSGI. Aug 29 21:25:44.357619 dv-cinder-854264-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 21:25:44.358155 dv-cinder-854264-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 21:25:44.360940 dv-cinder-854264-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:25:44.371609 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:25:44 2022] *** Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: nodename: dv-cinder-854264-2-iscsi Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: machine: x86_64 Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: clock source: unix Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: pcre jit disabled Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: detected number of CPU cores: 4 Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: current working directory: / Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:25:44.374504 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: your processes number limit is 47680 Aug 29 21:25:44.375232 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: your memory page size is 4096 bytes Aug 29 21:25:44.375232 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: detected max file descriptor number: 2048 Aug 29 21:25:44.375232 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: lock engine: pthread robust mutexes Aug 29 21:25:44.375232 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: thunder lock: enabled Aug 29 21:25:44.375232 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:25:44.375232 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:25:44.416821 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: Python main interpreter initialized at 0x559608e8a9c0 Aug 29 21:25:44.416821 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: python threads support enabled Aug 29 21:25:44.416821 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: your server socket listen backlog is limited to 100 connections Aug 29 21:25:44.416821 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:25:44.417331 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:25:44.417331 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: *** Operational MODE: preforking *** Aug 29 21:25:44.417480 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:25:44.417480 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: spawned uWSGI master process (pid: 121545) Aug 29 21:25:44.417663 dv-cinder-854264-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:25:44.418249 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: spawned uWSGI worker 1 (pid: 121558, cores: 1) Aug 29 21:25:44.419049 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: spawned uWSGI worker 2 (pid: 121559, cores: 1) Aug 29 21:25:44.419049 dv-cinder-854264-2-iscsi devstack@n-api.service[121545]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:25:45.093766 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:25:45.094589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:25:46.278477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:46.278477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: from cryptography.utils import int_from_bytes Aug 29 21:25:46.279294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:46.279294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: from cryptography.utils import int_from_bytes Aug 29 21:25:46.293196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:46.293196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: from cryptography.utils import int_from_bytes Aug 29 21:25:46.293830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:46.293830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: from cryptography.utils import int_from_bytes Aug 29 21:25:48.737931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:25:48.738478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:25:48.738821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:25:48.739088 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:25:48.739347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:25:48.739736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.740091 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.740414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.740735 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.741230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.741552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.741886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.742212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.742547 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.742810 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.743126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.743451 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-2-iscsi {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.743776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.744112 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.744422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.744740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.745047 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.745368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.745677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.746181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.747658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.747658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.747658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.747658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.748084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.748172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.748497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.748797 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.749115 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.749437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.749852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-2-iscsi {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.750159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.750467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.750644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:25:48.751120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.751234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:25:48.751316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.751531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:25:48.751654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.751840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.752068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:25:48.752068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:25:48.752236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.752484 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.752765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.753039 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.753432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.753724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.753953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.754172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.754391 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.754611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.754831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.755048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.755247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.755441 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.755629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.755629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.755982 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.756144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.756301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.756301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.756591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.756591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.756926 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.757081 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.757233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854264-2-iscsi {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.757410 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.757564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.757724 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.757880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.758077 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.758264 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.758414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.758575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.758736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.758908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.759061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.759207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.759378 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.759561 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.759725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.759725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.760069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.760261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.760419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.760629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.760789 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.760942 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.761103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.761259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.761411 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.761565 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.762658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.762828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.762976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.763128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.763286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.763441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.763592 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.763754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.763947 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.764124 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.764284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.764440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.764440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.764731 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854264-2-iscsi {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.764884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.765045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.765045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.765328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.765328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.765611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.765755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.765931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.766095 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.766240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.766391 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.766535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.766694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.766848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.766993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.767145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.767299 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.767443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.767604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.767757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.768441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.768596 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.768752 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.768914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.769123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.769280 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.769441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.769627 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.769821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.769968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.770126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.770126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.770408 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.770563 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.770767 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.770926 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.771077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.771077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.771077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.771505 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.771657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.771820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.772976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.773148 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.773305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.773305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.773619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.773775 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.773932 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.774078 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.774231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.774382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.774543 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.774742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.774914 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.775067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.775211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.775380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.775615 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.775774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.775953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.776116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.776268 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.776424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.776581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.776740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.776895 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.777045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.777189 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.777342 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.777513 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.777665 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.777817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.777961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.778112 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.778269 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.778414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.778564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.778720 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.778865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.779008 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.779150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.779313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.779467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.779621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.779772 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.780012 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.780176 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.780322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.780474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.780636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.780843 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.780999 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.781144 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.781296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.781451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.781614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.781766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.781915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.782067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.783275 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.783446 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.784274 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.784440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.784595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.784595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.784890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.785050 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.785222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.785222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.785520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.785749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.785990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.786166 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.786321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.786477 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.786632 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.786632 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.786916 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.787074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.787230 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.787230 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.787516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.787667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.787818 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.788020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.788170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.788324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.788468 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.788619 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.788777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.788930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.789074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.789219 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.789381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.789535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.789689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.789845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.789990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.790135 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.790286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.790438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.790438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.790731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.790954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.791113 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.791279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.791439 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.791593 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.791746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.791973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.792138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.792311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.793532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.793697 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.793851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.794012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.794159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.794303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.794461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.794618 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.794774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.794929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.795073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.795218 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.795369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.795531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.795678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.795838 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.796021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.796178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.796323 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.796485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.796630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.796787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.796940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.797092 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.797244 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.797390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.797548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.797700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.797845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.797998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.798143 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.798287 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.798458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.798761 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.798928 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.799089 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.799089 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.799403 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.799562 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.799707 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.799850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.800044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.800198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.800352 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.800532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.800680 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.800824 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.801092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.801337 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.801576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.801740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.801904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.802056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.802210 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.802355 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:48.802528 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.803793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.804056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.804217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.804364 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.804364 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.804647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.804808 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.804953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.805110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.805262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.805416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.805573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.805808 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.805975 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.806129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.806129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.806412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.806563 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.806721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.806875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.807020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.807172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.807318 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.807472 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.807624 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.807777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.808099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.808099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.810292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.812692 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.813733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.814200 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.814368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.814527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.814683 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.815382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.815539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.815539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.815833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.816038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.816188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.816343 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.816497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.816650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.816803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.816956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.817118 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.817265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.817409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.817552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.817712 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.817865 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.818035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.818242 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.818408 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.818566 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.818719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.818864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.819018 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.820106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.820273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.820421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.820566 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.820719 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.820893 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.821048 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.821194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.821349 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.821504 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.821715 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.821879 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.822024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.822168 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.822321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.822530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.822695 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.822695 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.823008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.823972 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.824424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.824581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.824581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.824885 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.825039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.825194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.825339 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.825491 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.825646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.825792 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.825944 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.826102 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.826247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.826247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.826545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.826691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.826834 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.826978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.827121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.827280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.827425 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.827569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.827713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.827872 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.828080 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.828239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.828392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.828537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.828697 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.828843 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.828994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.829149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.829303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.829449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.829601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.829746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.829915 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.830085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.830239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.830454 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.830454 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.831251 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.831410 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.831556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.831709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.831855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.832043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.832199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.832355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.832511 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.832723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.832869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.833014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.833195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.833195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.834840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.834990 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.835137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.835290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.835290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.835587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.835733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.835923 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.836088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.836244 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.836399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.836545 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.836689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.836841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.836995 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.837149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.837305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.837450 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.837737 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.837905 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.838065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.838213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.838371 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.838533 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.838685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.838830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.839050 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.839229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.839386 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.839539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.839700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.839862 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.840085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.840266 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.840414 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.840557 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.840708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.840860 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.841005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.841162 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.841308 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.841454 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.841597 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.841741 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.841892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.842063 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.842217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.842363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.842516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.842732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.842881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.843035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.843181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.843333 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.843498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.845291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.845488 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.845646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.845808 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.845994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.846147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.846293 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.846525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.846691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.846879 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.847037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.847189 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.847363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.847646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.847815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.848798 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.849073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.849296 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.849533 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.849770 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.849981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.850202 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.850401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.850574 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.850721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.850880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.850880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.851158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.851312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.851471 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.851699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.851857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.852077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.852242 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.852390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.852574 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.852865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.853067 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.853216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.853216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.853508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.853681 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.854149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.855050 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.855207 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.855504 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.855665 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.855817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.856001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.856151 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.856295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.856449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.856594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.856753 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.856920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.857187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.857365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.857516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.857676 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.857831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.857983 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.858137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.858282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.858426 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.858577 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.858731 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.858884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.859040 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.859194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.859194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.859468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.859621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.859765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.859971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.860135 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.860291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.860445 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.860591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.860744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.860896 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.861058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.861211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.861365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.861518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.861702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.861855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.862021 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.862211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.862370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.862517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.862662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.862807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.863016 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.863179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.863335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.863335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.863629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.863774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.863978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.864351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.864522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.865293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.865457 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.865742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.865902 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.866064 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.866221 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.866376 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.866524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.866667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.866811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.866968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.867121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.867266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.867418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.867573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.867726 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.867902 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.868078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.868232 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.868385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.868530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.868689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.868836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.868980 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.869131 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.869284 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.869430 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.869588 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.869588 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.869877 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.870037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.870191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.870336 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.870494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.870639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.870784 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.870928 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.871072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.871223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.871394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.871547 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.871698 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.871850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.872046 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.872264 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.872427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.872580 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.872731 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.872892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.873106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.873268 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.873268 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.873567 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.873725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.873892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.874075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.874075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.874654 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.874833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.874833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.875769 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.876125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.876125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.876437 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.876592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.876592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.876898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.877061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.877061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.877898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.878052 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.878214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.878384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.878384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.878689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.878910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.879070 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.879239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.879408 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.879561 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.879713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.879904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.880077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.880239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.880397 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.880549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.880700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.880860 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.881022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.881183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.881345 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.881505 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.881666 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.881826 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.881998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.882151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.882311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.882464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.882616 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.882768 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.883003 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.883223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.883384 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.883552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.883704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.883704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.884053 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.884209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.884369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.884768 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.884928 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.886487 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.886657 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.886811 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.886965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.887124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.887278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.887278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.887579 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.887744 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.887957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.888130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.888283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.888448 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.888602 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.888762 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.888914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.889075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.889236 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.889390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.889550 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.889712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.889888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.890042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.890213 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.890366 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.890517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.890678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.890909 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.891072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.891224 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.891384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.892114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.892282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.892282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.892593 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.892754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.893504 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.893696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.893854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.894014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.894167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.894327 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.894488 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.894670 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.895050 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.895050 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.895689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.895689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.896070 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.896070 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.896876 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.897039 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.897192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.897352 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.897515 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.897515 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.897814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.897974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.898147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.898301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.898461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.898623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.898918 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.899102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.899258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.899418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.899583 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.899736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.899942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.900114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.900269 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.900440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.900603 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.900755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.900755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901044 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901687 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.901998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.902594 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.902758 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.902758 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.903055 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.903221 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.903375 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.903579 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.903738 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.903910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.910058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.910298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.910483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.910646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.910805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.911045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.911217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.911374 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.911535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.911699 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.912037 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.912209 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.912412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.912629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.912796 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.913738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.913920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.914078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.914244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.914407 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.914564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.914718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.914882 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.915056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.915255 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.915413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.915565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.915565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.915954 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.916127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.916291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.916470 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.916654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.916836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.917012 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.917185 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.917340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.917492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.917651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.917805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.917958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.919518 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.919704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.919862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.920065 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.920222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.920385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.920554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.920717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.920877 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.921031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.921185 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.921348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.923661 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.923942 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.924142 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.924323 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.924483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.924657 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.924823 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.924987 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.925142 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.925298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.925460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.925624 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.925784 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.925946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.926112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.926266 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.926419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.926582 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.926743 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.926897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.927049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.927202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.927369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.927369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.927369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.927805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.928070 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.928250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.928468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.928468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.928829 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.928984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.931038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.931038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.931038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.931038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.931038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.935840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.936153 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.936967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.937137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.937295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.937465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.937620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.937804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.937969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.938123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.938290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.938468 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.938468 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.938852 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.938852 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.939278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.939495 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.940249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.940427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.940592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.940746 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.940908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.940908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.942244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.942433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.942611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.942766 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.942928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.943096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.943298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.943474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.943667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.943834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.944028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.944186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.944567 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.944784 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.944952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.945127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.945334 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.945492 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.945646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.945646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.946055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.946055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.946371 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.946533 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.946689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.946689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.946994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.947158 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.947322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.947483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.947636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.947835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.948015 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.948015 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.948330 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.948491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.948653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.948812 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.948965 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.949131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.949300 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.949496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.949660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.949813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.949972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.950135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.950288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.950441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.950600 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.950753 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.950911 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.951073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.952250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.952439 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.952608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.952929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.953110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.953272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.953447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.953655 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.953810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.953810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.953987 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.954082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.954169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.954263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.954496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.954496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.954934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.954934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.955106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.955192 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.955277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.955277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956364 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956553 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.956911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957004 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957392 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957632 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957745 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957862 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.957994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.958116 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.958231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.958362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.958362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.958873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.959031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.959171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.959310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.959449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.959580 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.959718 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.959849 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.960059 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.960191 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.960330 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.960474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.960613 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.960745 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.960876 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.961053 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.961053 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.961325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.961458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.961558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.961752 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.962036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.962234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.962499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.962604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.962739 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.962843 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.962945 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963346 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963541 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.963946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964122 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964122 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964386 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964730 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.964944 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965097 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965784 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.965966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966143 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966547 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966633 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966826 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.966919 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967176 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967276 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967362 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967362 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967613 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967701 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967701 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.967879 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970681 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.970953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.971658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.971758 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.971846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.972139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.972287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.972287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.972676 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.972775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.972862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.972862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973206 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973206 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973545 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973900 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.973983 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974450 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974536 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.974985 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975501 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975905 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.975996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976071 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976143 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976228 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976228 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976882 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.976962 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977404 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977647 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977885 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.977966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978285 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978375 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978529 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978673 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978743 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978895 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.978966 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979118 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979200 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979285 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979358 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979437 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979587 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979587 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.979864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980336 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980648 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.980969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981415 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981488 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981641 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981868 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.981948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.982027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.982181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.982406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.982526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.982658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.982903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983527 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983907 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.983997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984165 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984165 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984760 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984760 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.984976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985594 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985737 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.985958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.986028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.986108 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.986208 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.986295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.986416 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.986585 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.987243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.987372 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.987499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.987613 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.987613 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.987845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988046 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988302 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988374 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988446 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988604 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988756 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988916 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.988987 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989225 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989305 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989485 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989583 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989676 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989769 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989862 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.989954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990069 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990157 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990514 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990613 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990786 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.990972 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991244 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991348 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991701 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.991985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992071 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992552 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.992943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993573 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993661 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993758 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993852 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.993937 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994115 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994387 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994479 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994655 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.994927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995488 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995573 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995743 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:48.995975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005097 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005588 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.005959 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006713 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006798 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006883 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006974 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.006974 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.007958 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008067 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.008981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009262 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.009953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010046 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010132 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010299 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010392 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010562 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010822 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.010919 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011005 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011089 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011173 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011441 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011525 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011609 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011781 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.011874 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012557 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012557 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012875 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.012980 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013062 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013441 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013529 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013889 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.013964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014148 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014852 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.014974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015061 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015218 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015300 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015387 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015469 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015549 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015861 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.015968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016124 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016354 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016571 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016643 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016802 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.016953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017026 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017190 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017404 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017624 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017706 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017886 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.017961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018040 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018040 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018844 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.018938 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019025 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019204 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019303 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019386 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019643 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.019831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020264 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020453 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020553 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020648 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020823 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.020982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021178 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021264 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021349 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021530 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.021977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022070 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022070 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022237 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.022790 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023186 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023393 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023672 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.023834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024508 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024601 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024853 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.024932 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025299 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025528 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.025862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.026494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.027720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028960 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028960 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028960 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028960 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.028960 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.029356 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.029462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.029785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.030121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.030458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.030777 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.031113 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.031449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.031806 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.032154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.032530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.032867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.033193 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.034033 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.034346 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:49.034594 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:25:49.078039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO dbcounter [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Registered counter for database nova_api Aug 29 21:25:49.097095 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO dbcounter [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Registered counter for database nova_api Aug 29 21:25:49.100040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.106710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writer thread running {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.118244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_db.sqlalchemy.engines [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.125158 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writer thread running {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.167368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.context [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d54c4588-655f-44d3-a4d7-897122969839(cell1) {{(pid=121558) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:25:49.171475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:49.171980 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:49.173563 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:49.174418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:49.175126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:49.177196 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:49.179257 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO dbcounter [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Registered counter for database nova_cell0 Aug 29 21:25:49.183174 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.context [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d54c4588-655f-44d3-a4d7-897122969839(cell1) {{(pid=121559) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:25:49.183544 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO dbcounter [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Registered counter for database nova_cell1 Aug 29 21:25:49.187354 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:49.187927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:49.189543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:49.190321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:49.190773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:49.192929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:49.193112 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.193805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.195072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO dbcounter [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Registered counter for database nova_cell0 Aug 29 21:25:49.199244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO dbcounter [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Registered counter for database nova_cell1 Aug 29 21:25:49.201194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writer thread running {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.203355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writer thread running {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.207478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_db.sqlalchemy.engines [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.210335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_db.sqlalchemy.engines [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.216464 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writer thread running {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.218124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writer thread running {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.358899 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO dbcounter [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Registered counter for database nova_cell0 Aug 29 21:25:49.367005 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.372011 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writer thread running {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.372976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO dbcounter [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Registered counter for database nova_cell0 Aug 29 21:25:49.381218 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_db.sqlalchemy.engines [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:49.386473 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writer thread running {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:49.693314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: WARNING keystonemiddleware.auth_token [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:49.700782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: WARNING keystonemiddleware.auth_token [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:49.713933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: WARNING keystonemiddleware.auth_token [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:49.721496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: WARNING keystonemiddleware.auth_token [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:50.057960 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: WARNING keystonemiddleware.auth_token [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:50.065703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: WARNING keystonemiddleware.auth_token [None req-e7ee930e-01f8-4b5a-8e76-0213eb2de9d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:50.071094 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559608e8a9c0 pid: 121558 (default app) Aug 29 21:25:50.078304 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: WARNING keystonemiddleware.auth_token [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:50.085427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: WARNING keystonemiddleware.auth_token [None req-f247c1e6-d768-4bae-95a4-3df0940a4984 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:50.090819 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559608e8a9c0 pid: 121559 (default app) Aug 29 21:26:29.436946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=3 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.438652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=3 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.440120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=3 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.441254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=3 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.786159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-cd4e94fa-067a-473f-a78b-9dc06c3f597a tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Action: 'create', calling method: .version_select at 0x7fc841214e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1130714742"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:33.912508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-cd4e94fa-067a-473f-a78b-9dc06c3f597a tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.488831 Aug 29 21:26:33.913508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Aug 29 21:26:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4494 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:26:34.324943 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c1fe777f-92d4-4130-93e0-b9ae5213a14a tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8412779d0>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:34.411966 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:34.414145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:34.416382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:34.417300 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.178020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c1fe777f-92d4-4130-93e0-b9ae5213a14a tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f" status: 200 len: 345 microversion: 2.1 time: 1.252359 Aug 29 21:26:35.178982 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 1/2] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:26:33 2022] GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f => generated 345 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:36.192870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d4a504fa-f209-4f6d-9d2e-b0e0b8b4440c tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc84108dca0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:36.478494 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d4a504fa-f209-4f6d-9d2e-b0e0b8b4440c tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f" status: 200 len: 346 microversion: 2.1 time: 0.289464 Aug 29 21:26:36.480056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:26:36 2022] GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f => generated 346 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:36.501461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-28f230db-9e6e-4eb1-94dd-99556b17a5e5 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Action: 'create', calling method: .version_select at 0x7fc8410c9ca0>, body: {"snapshot": {"volume_id": "b7088b8e-f205-4396-8bb4-fbf1dfeeb55f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-817229133"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:37.642711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-28f230db-9e6e-4eb1-94dd-99556b17a5e5 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.153466 Aug 29 21:26:37.643307 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 2/4] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Aug 29 21:26:36 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:26:37.654486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-94f2731a-fa1d-462f-843b-eacad6f6bc8c tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410ad3a0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:37.819188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-94f2731a-fa1d-462f-843b-eacad6f6bc8c tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 286 microversion: 2.1 time: 0.164867 Aug 29 21:26:37.819188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 3/5] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:37 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:37.828644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-106ef584-e8bc-47c1-8ce6-e9ae6fd0be9a tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc841093a60>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:37.919524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-106ef584-e8bc-47c1-8ce6-e9ae6fd0be9a tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.095580 Aug 29 21:26:37.920557 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 3/6] 10.222.0.65 () {58 vars in 1140 bytes} [Mon Aug 29 21:26:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:26:37.933422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-cb864f1e-0469-4a21-9b5d-03bcb8b8e41e tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410adaf0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:37.991036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-cb864f1e-0469-4a21-9b5d-03bcb8b8e41e tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 286 microversion: 2.1 time: 0.062806 Aug 29 21:26:37.992228 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:37 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:26:39.005494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3c27bdfc-7e9e-40dc-a635-7487cf01add9 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc841093e50>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:39.071009 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3c27bdfc-7e9e-40dc-a635-7487cf01add9 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 286 microversion: 2.1 time: 0.070576 Aug 29 21:26:39.071573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:38 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:40.085378 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-507a88d0-0cb9-4aa2-99f8-2c662dc0f9b7 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc84108dca0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:40.173393 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-507a88d0-0cb9-4aa2-99f8-2c662dc0f9b7 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 286 microversion: 2.1 time: 0.091994 Aug 29 21:26:40.174645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 5/9] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:40 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:41.186608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-758809db-54dd-43fc-b361-4614a97e3658 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410a9940>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:41.253854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-758809db-54dd-43fc-b361-4614a97e3658 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 287 microversion: 2.1 time: 0.067201 Aug 29 21:26:41.253854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 5/10] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:41 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:41.262296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f8aecfde-3490-412d-98ef-31f8e803bd68 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410adb80>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:41.600888 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f8aecfde-3490-412d-98ef-31f8e803bd68 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 202 len: 0 microversion: 2.1 time: 0.342132 Aug 29 21:26:41.601819 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 6/11] 10.222.0.65 () {58 vars in 1254 bytes} [Mon Aug 29 21:26:41 2022] DELETE /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:26:41.611388 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-25b15b5e-25e6-4481-895c-6c788047094e tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410a93a0>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:41.683953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-25b15b5e-25e6-4481-895c-6c788047094e tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 286 microversion: 2.1 time: 0.076188 Aug 29 21:26:41.690357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:41 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:42.697747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4134fe6c-01bb-4b4c-a91d-7ca30f4a553e tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410ad3a0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:42.758184 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4134fe6c-01bb-4b4c-a91d-7ca30f4a553e tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 286 microversion: 2.1 time: 0.064404 Aug 29 21:26:42.763558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:42 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:43.501892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1532680408", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "networks": [{"uuid": "a03b07cd-ec6e-4782-bd47-f6ab0486a61a"}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:43.717272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] validate_networks() for [('a03b07cd-ec6e-4782-bd47-f6ab0486a61a', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:26:43.771564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e8272a2a-6692-422f-b641-8c816aca20e9 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410ad160>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:43.843182 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e8272a2a-6692-422f-b641-8c816aca20e9 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 200 len: 286 microversion: 2.1 time: 0.075885 Aug 29 21:26:43.843839 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 8/14] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:43 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:26:44.856001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-90321104-1744-4e5e-9fa0-31ac0f665990 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410ad820>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:44.958929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-90321104-1744-4e5e-9fa0-31ac0f665990 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] HTTP exception thrown: Snapshot f0004eb8-e659-4677-84be-4337e6a0f272 could not be found. Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-90321104-1744-4e5e-9fa0-31ac0f665990 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Request method failure captured: Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 HTTP/1.1 Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8FUG6OTkmd5-nhcPPVitleK32jItyTckQFIxmReIjtYxgOXnXBbS3UmQ-jWPrw4gqmzx9MtDBqBaCedKq4YWAWAFPXorfYApf7bHOFb_U1IX9EdfceCVVHdLA78gNWGmcV9WtwwWbePFNHRe9YWg48EVH9IbfHqit01PRwRRqsdzA Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:26:44.966892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8c7b1ec1f3fa4f38ac616f3d03ec5a10", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: fe195a70eb1a470e8f6c7eb1da7dc67c Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Snapshot f0004eb8-e659-4677-84be-4337e6a0f272 could not be found. Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'f0004eb8-e659-4677-84be-4337e6a0f272'} Aug 29 21:26:44.968129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f0004eb8-e659-4677-84be-4337e6a0f272 could not be found. (HTTP 404) (Request-ID: req-6afb9ff3-ae9b-424c-a2e6-5b66b820a83e) Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:26:44.968791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:26:44.970171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f0004eb8-e659-4677-84be-4337e6a0f272 could not be found. Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 21:26:44.971125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f0004eb8-e659-4677-84be-4337e6a0f272 could not be found. Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f0004eb8-e659-4677-84be-4337e6a0f272 could not be found. Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-90321104-1744-4e5e-9fa0-31ac0f665990 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Returning 404 to user: Snapshot f0004eb8-e659-4677-84be-4337e6a0f272 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-90321104-1744-4e5e-9fa0-31ac0f665990 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272" status: 404 len: 111 microversion: 2.1 time: 0.116478 Aug 29 21:26:44.972123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 9/15] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:26:44 2022] GET /compute/v2.1/os-snapshots/f0004eb8-e659-4677-84be-4337e6a0f272 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:26:44.996985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9df9b944-6475-4f6c-9855-008b711dabbe tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8410185e0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:45.379782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9df9b944-6475-4f6c-9855-008b711dabbe tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f" status: 202 len: 0 microversion: 2.1 time: 0.386635 Aug 29 21:26:45.380683 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 10/16] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:26:44 2022] DELETE /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:26:45.391139 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d7321d70-c14f-4fbb-ba79-8d118e284efa tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc841018d30>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:45.574325 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d7321d70-c14f-4fbb-ba79-8d118e284efa tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f" status: 200 len: 345 microversion: 2.1 time: 0.188493 Aug 29 21:26:45.575089 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 11/17] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:26:45 2022] GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f => generated 345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:26:46.328400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5857b56a-b64d-41a4-8959-2871ec301ac1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: .version_select at 0x7fc84101e3a0>, body: {"keypair": {"name": "tempest-keypair-305031631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdIxw9+Gp6b+4tyhB85emTJ3/2vG5Ps7TAVYXVDKVupTWvpaoUvrqzvcIT4xQ+NWnqm/TOLe5v+Jk8o5SrPWC/UQRbCogWU+AB2SDYw22FSUrEoc4K1UN0d6KHbprztdA=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:46.379570 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:26:46.379570 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:26:46.380148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:26:46.381373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:26:46.381373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:26:46.409458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:46.417005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:46.417672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:46.423596 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:46.424178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:46.428248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:46.441266 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-5857b56a-b64d-41a4-8959-2871ec301ac1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:26:46.478824 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-5857b56a-b64d-41a4-8959-2871ec301ac1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:26:46.532106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Getting quotas for project c852db97ba734c7088df6af689b41d16. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:26:46.544668 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Getting quotas for user e135d9b5894147e6a391d75d8896f094 and project c852db97ba734c7088df6af689b41d16. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:26:46.584264 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:26:46.594699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:26:46.712662 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5857b56a-b64d-41a4-8959-2871ec301ac1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.728264 Aug 29 21:26:46.713294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 12/18] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:26:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:26:46.910835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6834a579-02a6-4d4a-a8b4-c643a56b9e49 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.770764 Aug 29 21:26:46.917498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 7/19] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:26:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:26:46.927520 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-96169e6b-dc60-42ca-8c98-79e952c947ae tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc840fad940>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:47.036220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-96169e6b-dc60-42ca-8c98-79e952c947ae tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] HTTP exception thrown: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-96169e6b-dc60-42ca-8c98-79e952c947ae tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Request method failure captured: Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f HTTP/1.1 Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8FUG6OTkmd5-nhcPPVitleK32jItyTckQFIxmReIjtYxgOXnXBbS3UmQ-jWPrw4gqmzx9MtDBqBaCedKq4YWAWAFPXorfYApf7bHOFb_U1IX9EdfceCVVHdLA78gNWGmcV9WtwwWbePFNHRe9YWg48EVH9IbfHqit01PRwRRqsdzA Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:26:47.075573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8c7b1ec1f3fa4f38ac616f3d03ec5a10", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: fe195a70eb1a470e8f6c7eb1da7dc67c Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': 'b7088b8e-f205-4396-8bb4-fbf1dfeeb55f'} Aug 29 21:26:47.076707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. (HTTP 404) (Request-ID: req-68071a63-51d1-4fc6-8f09-c17aee3d3cbf) Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.078167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:26:47.079364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:26:47.081415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.083810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.087217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-96169e6b-dc60-42ca-8c98-79e952c947ae tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Returning 404 to user: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:26:47.088504 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-96169e6b-dc60-42ca-8c98-79e952c947ae tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f" status: 404 len: 109 microversion: 2.1 time: 0.169426 Aug 29 21:26:47.111223 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 8/20] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:26:46 2022] GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f => generated 109 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:26:47.164586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-88295dac-7554-49f4-907b-962f86e62439 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:47.168415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-88295dac-7554-49f4-907b-962f86e62439 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:47.202709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1925643939", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:47.410369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.network.neutron [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] validate_networks() for [('8f98a05d-9a6f-4b38-8a53-5d74a6efa394', None, None, None, None, None)] {{(pid=121558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:26:47.605496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-88295dac-7554-49f4-907b-962f86e62439 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:47.656172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-88295dac-7554-49f4-907b-962f86e62439 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1215 microversion: 2.1 time: 0.530670 Aug 29 21:26:47.660087 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 9/21] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:47 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1215 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:47.696010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-abfa5182-3919-4fe3-847e-c4957205b064 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8406bfb80>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:47.796134 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-abfa5182-3919-4fe3-847e-c4957205b064 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] HTTP exception thrown: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-abfa5182-3919-4fe3-847e-c4957205b064 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Request method failure captured: Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f HTTP/1.1 Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8FUG6OTkmd5-nhcPPVitleK32jItyTckQFIxmReIjtYxgOXnXBbS3UmQ-jWPrw4gqmzx9MtDBqBaCedKq4YWAWAFPXorfYApf7bHOFb_U1IX9EdfceCVVHdLA78gNWGmcV9WtwwWbePFNHRe9YWg48EVH9IbfHqit01PRwRRqsdzA Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:26:47.799030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8c7b1ec1f3fa4f38ac616f3d03ec5a10", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: fe195a70eb1a470e8f6c7eb1da7dc67c Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': 'b7088b8e-f205-4396-8bb4-fbf1dfeeb55f'} Aug 29 21:26:47.800303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. (HTTP 404) (Request-ID: req-3293aa99-c33a-4564-ab42-9cd165162f49) Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.801052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:26:47.802367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:26:47.803522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-abfa5182-3919-4fe3-847e-c4957205b064 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Returning 404 to user: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-abfa5182-3919-4fe3-847e-c4957205b064 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f" status: 404 len: 109 microversion: 2.1 time: 0.128335 Aug 29 21:26:47.805067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 10/22] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:26:47 2022] DELETE /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:26:47.810630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b4f8cfe9-9819-4c09-bbe9-e98fb5dafad3 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Calling method '.version_select at 0x7fc8406cc160>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:47.900027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-b4f8cfe9-9819-4c09-bbe9-e98fb5dafad3 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] HTTP exception thrown: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b4f8cfe9-9819-4c09-bbe9-e98fb5dafad3 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Request method failure captured: Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f HTTP/1.1 Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8FUG6OTkmd5-nhcPPVitleK32jItyTckQFIxmReIjtYxgOXnXBbS3UmQ-jWPrw4gqmzx9MtDBqBaCedKq4YWAWAFPXorfYApf7bHOFb_U1IX9EdfceCVVHdLA78gNWGmcV9WtwwWbePFNHRe9YWg48EVH9IbfHqit01PRwRRqsdzA Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:26:47.902048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8c7b1ec1f3fa4f38ac616f3d03ec5a10", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8c7b1ec1f3fa4f38ac616f3d03ec5a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8c7b1ec1f3fa4f38ac616f3d03ec5a10 Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-505760197 Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: fe195a70eb1a470e8f6c7eb1da7dc67c Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesSnapshotsTestJSON-505760197-project Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': 'b7088b8e-f205-4396-8bb4-fbf1dfeeb55f'} Aug 29 21:26:47.903370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. (HTTP 404) (Request-ID: req-480699b1-a626-4671-bdba-261ff22324c3) Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.906463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:26:47.907783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:26:47.909108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b4f8cfe9-9819-4c09-bbe9-e98fb5dafad3 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] Returning 404 to user: Volume b7088b8e-f205-4396-8bb4-fbf1dfeeb55f could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b4f8cfe9-9819-4c09-bbe9-e98fb5dafad3 tempest-VolumesSnapshotsTestJSON-505760197 tempest-VolumesSnapshotsTestJSON-505760197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f" status: 404 len: 109 microversion: 2.1 time: 0.096814 Aug 29 21:26:47.910259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 11/23] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:26:47 2022] GET /compute/v2.1/os-volumes/b7088b8e-f205-4396-8bb4-fbf1dfeeb55f => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:26:48.702928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1044b9ac-326b-47ad-bbd1-8b4c0b387e98 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:48.707768 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1044b9ac-326b-47ad-bbd1-8b4c0b387e98 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:48.914728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1044b9ac-326b-47ad-bbd1-8b4c0b387e98 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:48.927499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1044b9ac-326b-47ad-bbd1-8b4c0b387e98 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1215 microversion: 2.1 time: 0.240199 Aug 29 21:26:48.928172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 12/24] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:48 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:49.851812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-414e53ab-769f-442b-8a98-69624996fbfb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'create', calling method: .version_select at 0x7fc8406cc0d0>, body: {"keypair": {"name": "tempest-keypair-187429163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXrU1YsBPg2Jc/CI2068aNbly+HXxpU337kaDOhx9Y25RuzgPheXAztxp2nVK7yOd7GJ0Cr/pQk3rqKqRImhel9A+thGw6xvsuj95clvAS3v8z+V9GgieZQ+0FNLIBHAQ=="}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:49.925470 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-414e53ab-769f-442b-8a98-69624996fbfb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for project d8d35a885c494e11b42f556554f3698b. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:26:49.934038 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-414e53ab-769f-442b-8a98-69624996fbfb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for user d3c5edb153624912b87d61dd7ad5e4f3 and project d8d35a885c494e11b42f556554f3698b. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:26:50.100309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-414e53ab-769f-442b-8a98-69624996fbfb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.168535 Aug 29 21:26:50.102855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 13/25] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:26:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:50.144349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-60ec3902-d165-42ca-956d-c69a7bdff4f3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:50.145065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-60ec3902-d165-42ca-956d-c69a7bdff4f3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:50.430330 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-60ec3902-d165-42ca-956d-c69a7bdff4f3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:50.446736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-60ec3902-d165-42ca-956d-c69a7bdff4f3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1215 microversion: 2.1 time: 0.341855 Aug 29 21:26:50.455736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 14/26] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:50 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:50.494914 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Flavor limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:26:50.496198 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Image limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:26:50.496750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Flavor pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:26:50.497358 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Image pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:26:50.497830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:26:50.518668 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:50.526533 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:50.531279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:50.531279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:50.531279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:50.531279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:50.632461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for project bd7bb76694c2499895f24e611c644a27. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:26:50.654486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for user b7e0a78238e94fa4a8209550c901a9a5 and project bd7bb76694c2499895f24e611c644a27. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:26:50.704885 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Going to run 1 instances... {{(pid=121558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:26:50.721258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:26:51.097857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e9b3be82-02f9-4992-86a0-ca423de9296f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.383015 Aug 29 21:26:51.101750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 13/27] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:26:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:26:51.115286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-10e9c7f4-320d-402b-a787-6dfbfb336c4b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:51.115947 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-10e9c7f4-320d-402b-a787-6dfbfb336c4b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:51.373488 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-10e9c7f4-320d-402b-a787-6dfbfb336c4b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:51.382724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-10e9c7f4-320d-402b-a787-6dfbfb336c4b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1222 microversion: 2.1 time: 0.271981 Aug 29 21:26:51.410394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 15/28] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:51 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1222 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:51.475632 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:51.476350 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:51.518523 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:51.528940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:51.531482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:51.540718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:51.541425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:51.541943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:51.942015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1937373478", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:52.035373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] validate_networks() for [('8f98a05d-9a6f-4b38-8a53-5d74a6efa394', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:26:52.113362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:52.185177 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9327d11e-9834-4c39-9bb1-cc7e8d18d1a7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1211 microversion: 2.1 time: 0.713735 Aug 29 21:26:52.187094 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 14/29] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:51 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1211 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:53.225349 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:53.226026 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:53.234537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:53.238900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:26:53.239915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:53.240104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:26:53.240695 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:53.241094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:26:53.241645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:26:53.242194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:26:53.242988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:53.248559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:53.251767 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:53.254460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:53.255368 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:53.256034 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:53.257665 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:53.258312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:53.258922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:53.288275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for project bd7bb76694c2499895f24e611c644a27. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:26:53.293865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for user b7e0a78238e94fa4a8209550c901a9a5 and project bd7bb76694c2499895f24e611c644a27. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:26:53.334148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:26:53.347618 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:26:53.461099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:53.469084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7cc6aac0-b26c-4e57-8abf-ce4b6928b8a0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1275 microversion: 2.1 time: 0.247506 Aug 29 21:26:53.470581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 15/30] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:53 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:53.543968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-803dacf3-29e9-4b7f-b796-960f2b1a0bd0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.607337 Aug 29 21:26:53.548162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 16/31] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:26:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:26:53.569944 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d175ea3a-780c-46cb-97f0-21c83688142f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:53.570549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d175ea3a-780c-46cb-97f0-21c83688142f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:53.674227 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d175ea3a-780c-46cb-97f0-21c83688142f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:53.696651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d175ea3a-780c-46cb-97f0-21c83688142f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1222 microversion: 2.1 time: 0.132965 Aug 29 21:26:53.704497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 16/32] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:53 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:54.423701 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-791875057", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d52e082-ed9a-4937-bc0b-8b03e2527c03"}], "security_groups": [{"name": "tempest-securitygroup--1279496774"}], "key_name": "tempest-keypair-305031631", "user_data": "}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:54.496067 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:54.497311 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:54.530375 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:54.531185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:54.532158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:54.533496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:54.536925 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:54.537923 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:54.804060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:54.814464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c6fcbe33-9c6b-4395-a96c-42b48681c294 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1273 microversion: 2.1 time: 0.326131 Aug 29 21:26:54.815609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 17/33] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:54 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:54.820838 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-02c6c69a-ddd5-4fb6-b5c7-8d34dd9d3a20 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:54.821658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-02c6c69a-ddd5-4fb6-b5c7-8d34dd9d3a20 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:54.884195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] validate_networks() for [('5d52e082-ed9a-4937-bc0b-8b03e2527c03', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:26:55.033466 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-02c6c69a-ddd5-4fb6-b5c7-8d34dd9d3a20 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:55.042350 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-02c6c69a-ddd5-4fb6-b5c7-8d34dd9d3a20 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1222 microversion: 2.1 time: 0.225384 Aug 29 21:26:55.057854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 18/34] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:54 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1222 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:55.852409 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:55.853273 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:55.862467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:55.863428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:55.864693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:55.865805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:55.867100 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:55.869117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:56.335834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:56.359946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-59363534-a9b7-45d5-955a-b98f4ae1cf9d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.507190 Aug 29 21:26:56.364200 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 19/35] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:55 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:56.400650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:56.406357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:56.439310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:56.439310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:56.439310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:56.445699 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:56.449378 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:56.451098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:57.293395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:57.295168 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9bc713dd-6644-498b-bd63-289abb35a7c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1274 microversion: 2.1 time: 0.928868 Aug 29 21:26:57.314288 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 20/36] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:56 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1274 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:57.383055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:57.385104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:57.395409 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:57.396969 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:57.400786 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:57.405778 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:57.407696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:57.408175 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:57.579455 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:26:57.585657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:26:57.585657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:26:57.585657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:26:57.585657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:26:57.606712 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:57.607207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:57.610439 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:57.614142 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:57.618059 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:57.618059 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:57.678945 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:26:57.687010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:26:57.723236 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:26:57.732715 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:26:57.908619 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f6bc9cec-257b-440e-bf67-0608734f1235 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.495345 Aug 29 21:26:57.910015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 17/37] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:26:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 3498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:26:57.932020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2282abe7-a26f-4ef5-b223-bff9a65c57bb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:57.932020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2282abe7-a26f-4ef5-b223-bff9a65c57bb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:58.023306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2282abe7-a26f-4ef5-b223-bff9a65c57bb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:58.033214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2282abe7-a26f-4ef5-b223-bff9a65c57bb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1240 microversion: 2.1 time: 0.114510 Aug 29 21:26:58.034292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 18/38] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:57 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1240 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:58.155305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-548508584", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca335ec8-2cdb-4727-aad4-e94fc1adcada"}], "security_groups": [{"name": "tempest-securitygroup--1670744255"}], "key_name": "tempest-keypair-187429163", "user_data": "}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:58.529414 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] validate_networks() for [('ca335ec8-2cdb-4727-aad4-e94fc1adcada', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:26:58.709597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:58.740726 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e5bf7b62-c410-48f4-8784-99b106ac5308 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 1.354787 Aug 29 21:26:58.741892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 21/39] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:57 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:58.790296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:58.798128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:58.832858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:58.833668 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:58.834249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:58.835542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:58.844199 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:58.845447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:59.420949 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:59.432319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a30c7080-f8e1-4072-a7fa-8943405ba510 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1280 microversion: 2.1 time: 0.689118 Aug 29 21:26:59.454218 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 22/40] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:58 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1280 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:59.459124 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-62392d31-fde4-47d4-87f5-66d749d6d4f1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:59.459743 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-62392d31-fde4-47d4-87f5-66d749d6d4f1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:26:59.510671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:26:59.510671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:26:59.510671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:26:59.510671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:26:59.510671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:26:59.517168 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:59.517668 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:59.518109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:59.518848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:26:59.519311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:26:59.519791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:26:59.636581 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for project d8d35a885c494e11b42f556554f3698b. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:26:59.676508 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for user d3c5edb153624912b87d61dd7ad5e4f3 and project d8d35a885c494e11b42f556554f3698b. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:26:59.726211 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:26:59.743778 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:26:59.861432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.947143 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-62392d31-fde4-47d4-87f5-66d749d6d4f1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:26:59.956526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-62392d31-fde4-47d4-87f5-66d749d6d4f1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1240 microversion: 2.1 time: 0.501087 Aug 29 21:26:59.968265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 23/41] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:59 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1240 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:00.001051 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:00.002193 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:00.043389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e9cd82c5-e2f9-4509-9486-55a27180d64b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.885698 Aug 29 21:27:00.047098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:00.053996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 19/42] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:26:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:27:00.061239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:00.068846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:00.071258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:00.074072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4d0ca73f-4fca-4355-bb24-81656a208d30 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:00.077511 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4d0ca73f-4fca-4355-bb24-81656a208d30 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:00.085839 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:00.086509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:00.319042 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4d0ca73f-4fca-4355-bb24-81656a208d30 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:00.341482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4d0ca73f-4fca-4355-bb24-81656a208d30 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1236 microversion: 2.1 time: 0.278709 Aug 29 21:27:00.358192 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 20/43] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:00 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1236 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:00.454983 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:00.455727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:00.463856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:00.464393 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:00.471432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:00.471432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:00.471432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:00.471432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:00.603051 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.970981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:00.985538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ef356c04-8bad-4b40-b520-bc033d0831ae tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 1.021743 Aug 29 21:27:00.993148 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 24/44] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:26:59 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:01.002290 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:01.003702 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:01.022897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:01.025252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:01.025877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:01.028150 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:01.032042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:01.032507 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:01.324326 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:01.346531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f62c39fc-b306-43fc-85a6-822a589c97ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1280 microversion: 2.1 time: 0.894404 Aug 29 21:27:01.346531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 21/45] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:00 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1280 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:01.370038 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1127250c-5426-4629-bc0e-fc205ac577f1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:01.370667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1127250c-5426-4629-bc0e-fc205ac577f1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:01.503174 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1127250c-5426-4629-bc0e-fc205ac577f1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:01.511853 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1127250c-5426-4629-bc0e-fc205ac577f1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1236 microversion: 2.1 time: 0.145534 Aug 29 21:27:01.520869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 22/46] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:01 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1236 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:01.538280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:01.575630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0e3c852c-6287-4ddb-b185-d1a01ccfb3f9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1244 microversion: 2.1 time: 0.581424 Aug 29 21:27:01.577443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 25/47] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:00 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1244 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:02.023394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:02.028847 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:02.039205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.044114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.044962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:02.045892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.046504 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.047109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:02.373304 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:02.374009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:02.381336 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:02.387060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.387060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.387060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:02.393494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a1fb1536-bdf2-4464-bc4b-f10bfc88742a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.373329 Aug 29 21:27:02.393960 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 23/48] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:02 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:02.403981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.403981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.403981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:02.540092 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:02.541932 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:02.594486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.594486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.594486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:02.594486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.594955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.594955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:02.798742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:02.834420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-77f13302-5e51-4882-8454-7704d937569a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1240 microversion: 2.1 time: 0.282718 Aug 29 21:27:02.834420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 24/49] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:02 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1240 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:02.839270 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:02.840340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:02.858548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.867262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.867262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:02.867262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:02.867262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:02.867657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:03.002572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:03.036525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-35229ecb-e784-4be2-8cf0-9e317bfdec5c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1292 microversion: 2.1 time: 0.214064 Aug 29 21:27:03.037908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 25/50] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:02 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1292 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:03.042310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:03.058947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9358b08f-a7af-4aa2-a687-1d84c1e6befa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.689435 Aug 29 21:27:03.077514 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 26/51] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:02 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:03.418840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:03.419750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:03.433696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:03.434254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:03.435800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:03.436588 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:03.437060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:03.437495 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:03.662212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:03.673180 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-adf0fe29-1092-461a-a42f-dc612949fc24 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.258555 Aug 29 21:27:03.688572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-7e07281a-aa60-4244-80be-0e84a53fbd6c req-b1c3fb32-1a67-4448-9a77-45665569f7fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5c96ac-f97f-448f-beca-9f9caa324e64", "tag": "eba29033-b888-4888-a4cd-c1d7388e8109"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:03.689342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 27/52] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:03 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:03.705538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e07281a-aa60-4244-80be-0e84a53fbd6c req-b1c3fb32-1a67-4448-9a77-45665569f7fe service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:03.706123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e07281a-aa60-4244-80be-0e84a53fbd6c req-b1c3fb32-1a67-4448-9a77-45665569f7fe service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:03.706667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e07281a-aa60-4244-80be-0e84a53fbd6c req-b1c3fb32-1a67-4448-9a77-45665569f7fe service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:03.733255 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-7e07281a-aa60-4244-80be-0e84a53fbd6c req-b1c3fb32-1a67-4448-9a77-45665569f7fe service nova] Creating event network-changed:eba29033-b888-4888-a4cd-c1d7388e8109 for instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 on hv-cinder-85426 Aug 29 21:27:03.733793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e07281a-aa60-4244-80be-0e84a53fbd6c req-b1c3fb32-1a67-4448-9a77-45665569f7fe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:27:03.734257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e07281a-aa60-4244-80be-0e84a53fbd6c req-b1c3fb32-1a67-4448-9a77-45665569f7fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=121559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:27:03.735720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:03.736234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:03.736716 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:03.737531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:03.737994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:03.738645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:03.752253 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.compute.rpcapi [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:27:03.753171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] Releasing lock "compute-rpcapi-router" {{(pid=121559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:27:03.776880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-012ad638-487c-4692-93bd-3bb725a9f614 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.595019 Aug 29 21:27:03.785341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 26/53] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:03.842490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:03.844455 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:03.878931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:03.878931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:03.878931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:03.878931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:03.880508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:03.880508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:04.071471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:04.074477 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:04.085203 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:04.089943 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:04.090694 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:04.093902 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:04.095240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:04.097608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:04.101664 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:04.122999 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-204aec94-ddda-492a-bbcc-196e815c965a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1240 microversion: 2.1 time: 0.285321 Aug 29 21:27:04.123653 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 28/54] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:03 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1240 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:04.139371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:04.139904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:04.159673 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:04.163934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:04.163934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:04.163934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:04.163934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:04.164703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:04.263620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:04.281283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4345e879-6be1-48f9-be1b-fd2f578015ce tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1292 microversion: 2.1 time: 0.216642 Aug 29 21:27:04.294410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 27/55] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:04 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1292 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:04.698943 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:04.700682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:04.713061 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:04.717088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:04.721080 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:04.723175 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:04.728039 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:04.731314 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:05.316817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:05.332883 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-368ccccf-4343-4664-81ec-693a3fcf7f93 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.639089 Aug 29 21:27:05.334211 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 28/56] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:04 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:05.340271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:05.341460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:05.349537 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:05.350379 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:05.351019 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:05.352290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:05.352957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:05.353560 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:05.407436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:05.420346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-cc0def4d-d5c9-4167-9786-2eb4baaadbf8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 1.295515 Aug 29 21:27:05.421269 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 29/57] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:04 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:05.428535 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:05.429551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:05.436674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:05.444045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:05.444045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:05.444045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:05.444045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:05.444381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:05.482586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:05.492775 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-65120f3c-9bfc-414f-8d97-bea138232dce tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1232 microversion: 2.1 time: 0.156616 Aug 29 21:27:05.505736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 29/58] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:05 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1232 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:05.758009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:05.807316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e21ea6c5-2df6-4fbc-9a6a-adab193bebfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1300 microversion: 2.1 time: 0.383649 Aug 29 21:27:05.812529 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 30/59] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:05 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1300 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:05.814664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-b1c7db9a-1517-481c-a644-dc0d920b5f31 req-ef1e5dc2-45fa-4dd6-a7c3-d2967fe8d895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b9b318-ba34-455a-90b9-4ff5619fa02e", "tag": "9038f059-1399-4f98-9ce3-88cce7cf0565"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:05.840115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b1c7db9a-1517-481c-a644-dc0d920b5f31 req-ef1e5dc2-45fa-4dd6-a7c3-d2967fe8d895 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:05.840600 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b1c7db9a-1517-481c-a644-dc0d920b5f31 req-ef1e5dc2-45fa-4dd6-a7c3-d2967fe8d895 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:05.843955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b1c7db9a-1517-481c-a644-dc0d920b5f31 req-ef1e5dc2-45fa-4dd6-a7c3-d2967fe8d895 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:05.895443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-b1c7db9a-1517-481c-a644-dc0d920b5f31 req-ef1e5dc2-45fa-4dd6-a7c3-d2967fe8d895 service nova] Creating event network-changed:9038f059-1399-4f98-9ce3-88cce7cf0565 for instance 28b9b318-ba34-455a-90b9-4ff5619fa02e on hv-cinder-85426 Aug 29 21:27:05.908781 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-b1c7db9a-1517-481c-a644-dc0d920b5f31 req-ef1e5dc2-45fa-4dd6-a7c3-d2967fe8d895 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098463 Aug 29 21:27:05.911488 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 30/60] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:06.362920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:06.363923 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:06.376618 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.377497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.378489 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.383211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.383993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.384636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.442429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:06.443119 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:06.449699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.450538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.451190 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.452142 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.452801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.453987 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.643515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:06.647208 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=61 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:06.655019 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3b47ed21-38f1-4d29-9f6d-dc109cf5479c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.216706 Aug 29 21:27:06.665193 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 31/61] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:06 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:06.665193 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:06.665193 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:06.669739 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.671026 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.671734 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.673194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.673914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.674603 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.727870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:06.741289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-36a96fbf-3224-40be-a999-1e94d5405f15 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.385320 Aug 29 21:27:06.743851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 31/62] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:06 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:06.772497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:06.789549 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-324bbd6a-1395-4c9a-bb55-9e7ad4dab0af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1288 microversion: 2.1 time: 0.132024 Aug 29 21:27:06.790210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 32/63] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:06 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1288 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:06.904272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:06.904272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:06.904272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.904272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.904857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.904857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:06.904857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:06.904857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:06.948839 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:06.962355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d74f3dc7-9c74-4f13-a8d5-5b8224c56192 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1298 microversion: 2.1 time: 0.127079 Aug 29 21:27:06.963561 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 32/64] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:06 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:07.679137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:07.679746 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:07.687163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:07.687543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:07.688161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:07.689439 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:07.689958 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:07.690389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:07.917274 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:07.919355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:07.938695 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:07.939232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:07.943243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:07.946463 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:07.946463 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:07.946463 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:07.950041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.025079 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:08.059986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-34ccc7df-ffec-41bc-9a40-cd586c3936a1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.371514 Aug 29 21:27:08.059986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 33/65] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:07 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:08.088030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:08.088653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:08.102498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:08.102989 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:08.103422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:08.104154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:08.104608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:08.113827 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:08.124316 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:08.146432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a035340d-a75c-44a7-aa47-0e22da398e2d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1288 microversion: 2.1 time: 0.233782 Aug 29 21:27:08.150604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 33/66] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:07 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1288 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:08.158346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-29f24dcd-0de3-4f95-95bb-78e626dd7d11 req-74238960-5741-4de9-976f-8b3b4586e536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37678b50-656d-49b5-8f7a-5059a89f458d", "tag": "97d85e67-a7e1-4cc9-a19b-75eb2eaacfe5"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:08.189960 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-29f24dcd-0de3-4f95-95bb-78e626dd7d11 req-74238960-5741-4de9-976f-8b3b4586e536 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:08.192476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-29f24dcd-0de3-4f95-95bb-78e626dd7d11 req-74238960-5741-4de9-976f-8b3b4586e536 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:08.193091 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-29f24dcd-0de3-4f95-95bb-78e626dd7d11 req-74238960-5741-4de9-976f-8b3b4586e536 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:08.233247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-29f24dcd-0de3-4f95-95bb-78e626dd7d11 req-74238960-5741-4de9-976f-8b3b4586e536 service nova] Creating event network-changed:97d85e67-a7e1-4cc9-a19b-75eb2eaacfe5 for instance 37678b50-656d-49b5-8f7a-5059a89f458d on hv-cinder-85426 Aug 29 21:27:08.234088 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-29f24dcd-0de3-4f95-95bb-78e626dd7d11 req-74238960-5741-4de9-976f-8b3b4586e536 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:27:08.234551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-29f24dcd-0de3-4f95-95bb-78e626dd7d11 req-74238960-5741-4de9-976f-8b3b4586e536 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:27:08.236950 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:08.237477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:08.237910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:08.238788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:08.239634 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:08.240343 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:08.256128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.compute.rpcapi [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:27:08.256128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] Releasing lock "compute-rpcapi-router" {{(pid=121558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:27:08.277724 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bb3dadd7-46e9-415f-b534-5cd5313fd263 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124924 Aug 29 21:27:08.284361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 34/67] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:08.291776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:08.293006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:08.303049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:08.303538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:08.304009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:08.304763 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:08.305306 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:08.305611 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:08.599793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:08.613096 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0759001f-7456-4ecc-af34-f6cc801e1d70 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.545742 Aug 29 21:27:08.617472 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 34/68] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:08 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:09.073589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:09.074946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:09.098056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:09.098556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:09.098991 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:09.099707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:09.100197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:09.100621 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:09.393334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:09.409300 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bc5693b3-e599-4071-9884-f31c652d7b62 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 1.123576 Aug 29 21:27:09.423038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 35/69] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:08 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:09.428232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:09.429084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:09.436677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:09.438136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:09.438136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:09.438988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:09.439771 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:09.440396 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:09.628793 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:09.639856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4a95a75b-8155-45bc-ac75-a2cc4da5bf6f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1306 microversion: 2.1 time: 0.215351 Aug 29 21:27:09.642663 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 36/70] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:09 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1306 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:09.652813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:09.654979 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:09.668988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:09.674316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:09.674316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:09.674316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:09.674316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:09.674679 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:09.763422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:09.778911 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5f3c3e7b-4c2a-46c9-8baa-f5e69e063f51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.708614 Aug 29 21:27:09.802590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 35/71] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:09 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:09.955806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=16 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:10.202929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:10.214589 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2ce6f333-3489-4003-9bdb-832337f80467 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.570701 Aug 29 21:27:10.218676 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 37/72] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:09 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:10.437322 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:10.437322 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:10.438565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:10.439250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:10.439250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:10.439997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:10.440457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:10.440880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:10.681705 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:10.682392 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:10.684167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:10.692259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:10.692998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:10.693589 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:10.694456 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:10.695728 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:10.696343 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:10.711816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:10.722722 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-442a4e49-bba0-4a95-8b6f-03eaea305178 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.295728 Aug 29 21:27:10.723343 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 36/73] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:10 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:10.783638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:10.794167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b9e8b01b-eec8-498e-bd4a-6588ba05274f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1294 microversion: 2.1 time: 0.128286 Aug 29 21:27:10.794826 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 38/74] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:10 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:10.803342 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:10.804311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:10.811663 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:10.812584 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:10.813785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:10.814874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:10.815754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:10.817357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.058225 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:11.072021 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5788f3bd-7015-41cc-b2f1-279d607de473 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.270598 Aug 29 21:27:11.072021 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 37/75] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:10 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:11.242929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:11.243441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-03ad9a92-24d4-49a2-a88f-8fab72e454f3 req-8eb38edb-ea5f-4f40-b8ec-f978fc28d4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979806e6-6c73-40b1-a798-731653815edc", "tag": "32eade43-2044-402f-ab19-8fcb425b1b8a"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:11.243586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:11.255516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-03ad9a92-24d4-49a2-a88f-8fab72e454f3 req-8eb38edb-ea5f-4f40-b8ec-f978fc28d4f6 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:11.256329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-03ad9a92-24d4-49a2-a88f-8fab72e454f3 req-8eb38edb-ea5f-4f40-b8ec-f978fc28d4f6 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:11.261120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-03ad9a92-24d4-49a2-a88f-8fab72e454f3 req-8eb38edb-ea5f-4f40-b8ec-f978fc28d4f6 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.265387 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:11.266532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:11.266920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.267986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:11.268482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:11.268912 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.272128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-03ad9a92-24d4-49a2-a88f-8fab72e454f3 req-8eb38edb-ea5f-4f40-b8ec-f978fc28d4f6 service nova] Creating event network-changed:32eade43-2044-402f-ab19-8fcb425b1b8a for instance 979806e6-6c73-40b1-a798-731653815edc on hv-cinder-85426 Aug 29 21:27:11.277538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-03ad9a92-24d4-49a2-a88f-8fab72e454f3 req-8eb38edb-ea5f-4f40-b8ec-f978fc28d4f6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254630 Aug 29 21:27:11.279151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 39/76] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:11.456365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:11.480494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f9321a58-b660-4ed7-9e1a-e53d8267d28d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.247116 Aug 29 21:27:11.481082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 38/77] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:11 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:11.744894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:11.745828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:11.753197 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:11.755218 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:11.756196 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.757444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:11.758082 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:11.758838 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.823691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:11.823691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:11.825440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=42 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.834325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:11.835115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:11.836114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.837246 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:11.838071 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:11.838724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:11.948036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:11.956475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f8df585c-816a-419d-8669-aa1ddfa48e0e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.215830 Aug 29 21:27:11.957277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 40/78] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:11 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:12.018543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:12.026352 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d73f2d8d-ac9f-4bab-80a4-839d05743958 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.212520 Aug 29 21:27:12.027183 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 39/79] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:11 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:12.096973 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.097596 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:12.103597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:12.104117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:12.105488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:12.105488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:12.105718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:12.106141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:12.254644 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:12.266733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8578a381-7815-4a1e-9257-9df68480dcc5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.170778 Aug 29 21:27:12.266733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 41/80] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:12.501146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.502416 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:12.508660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:12.509181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:12.509621 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:12.510328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:12.510787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:12.511208 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:12.681734 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:12.692642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f0ffea22-c732-40eb-be11-b1f1c1a03692 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.195331 Aug 29 21:27:12.693152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 40/81] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:12.978444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.979078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:12.986018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:12.986512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:12.987010 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:12.987651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:12.988143 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:12.988564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:13.048525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:13.049412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:13.056452 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:13.057238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:13.057843 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:13.059658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:13.059658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:13.059658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:13.155525 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:13.165019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c5834179-6be1-400d-ac23-b356c015a722 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.190483 Aug 29 21:27:13.165923 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 42/82] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:13.221030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:13.230013 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6757f30e-f1c7-4867-b876-99949cda3154 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.185837 Aug 29 21:27:13.231156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 41/83] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:13 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:13.287260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:13.287868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:13.293898 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:13.294382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:13.294836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:13.295733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:13.296220 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:13.296670 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:13.643347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:13.653062 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a705776e-0215-40a3-bb05-1f8eb7e79a9e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.369541 Aug 29 21:27:13.653759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 43/84] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:13 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:13.718027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:13.718724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:13.724922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:13.725457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:13.725827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:13.726507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:13.726955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:13.727376 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:13.745676 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=10 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.871138 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:13.879783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-cd5f9702-8a36-498a-b42c-306fa5c31a19 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.165884 Aug 29 21:27:13.880401 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 42/85] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:13 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:14.186660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.187297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:14.193362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.193834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.194272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:14.194960 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.195413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.195835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:14.252402 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.253004 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:14.259209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.259687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.260156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:14.260850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.261296 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.261711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:14.329873 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:14.341548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-db07073c-1bc9-480c-bb5e-168983afffa0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.158514 Aug 29 21:27:14.343009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 44/86] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:14.406000 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:14.414937 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-da6618d2-e05c-4fca-a7cb-fac4a7ddf151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.166351 Aug 29 21:27:14.415550 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 43/87] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:14.677890 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.678505 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:14.685863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.685863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.685863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:14.686260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.686374 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.686787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:14.824009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:14.832704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c90c8d4c-2fd6-40c7-8c5f-6fecd850221b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.158706 Aug 29 21:27:14.834339 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 45/88] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:14.905851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.907013 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:14.913407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.914345 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.928438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:14.928438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:14.928438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:14.928438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:15.066068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:15.073863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-54498ef9-f9f4-4f6b-a921-1b411c51a438 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.172296 Aug 29 21:27:15.074570 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 44/89] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:15.364802 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:15.365412 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:15.376800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:15.377220 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:15.377654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:15.378365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:15.378821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:15.383609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:15.439356 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:15.440440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:15.447286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:15.448146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:15.448776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:15.449865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:15.450888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:15.452450 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:15.807812 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:15.819553 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-500e8605-a775-4afe-9bb5-a3b1a2e817b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.456855 Aug 29 21:27:15.821952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 46/90] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:15 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:15.856073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:15.856926 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:15.872090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:15.872947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:15.873713 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:15.874734 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:15.877012 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:15.878411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:16.050191 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:16.058798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-50ab26f8-d44a-478b-9e97-5a47e0c83ead tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.207640 Aug 29 21:27:16.059371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 47/91] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:15 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:16.099227 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:16.099931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:16.108347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:16.108927 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:16.109645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:16.110369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:16.110976 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:16.111396 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:16.253261 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:16.260138 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d507836c-f7b0-45b3-bca5-7e3023eebd66 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.826476 Aug 29 21:27:16.260743 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 45/92] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:15 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:16.327029 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:16.336691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0020d60c-924c-4863-8e7c-65171a80b69d tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.241189 Aug 29 21:27:16.337346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 48/93] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:16 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:16.841839 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:16.842727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:16.857695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:16.858587 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:16.859572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:16.860663 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:16.861457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:16.862217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.116425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:17.121892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:17.132243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:17.132971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:17.133423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.134136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:17.134925 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:17.135714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.278188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:17.286214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:17.287280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1f11fbd8-afa3-4e2c-b6e0-e571a31a9989 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.209206 Aug 29 21:27:17.288082 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 49/94] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:17 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:17.296719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ad5d1668-ea45-4543-9372-3f47a173a59c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.458683 Aug 29 21:27:17.307915 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 46/95] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:16 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:17.308135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:17.308135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:17.308431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:17.310721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:17.310721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.310721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:17.310721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:17.311093 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.359288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:17.360590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:17.366873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:17.367474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:17.368045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.368980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:17.369524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:17.370072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.452144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:17.456985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.464357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7568a9c0-9a3d-4288-af02-a3a6e7989a20 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.170984 Aug 29 21:27:17.465146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 50/96] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:17 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:17.516627 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-a3990555-a969-4131-af2f-99ac4063a421 req-94474043-5fc7-4d25-b4ba-b499ec4a2644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528c748a-ba74-44e6-b1a7-84ab068acfcb", "tag": "7063fec6-24ac-4c04-bef3-3f9ee9c54d76"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:17.531134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a3990555-a969-4131-af2f-99ac4063a421 req-94474043-5fc7-4d25-b4ba-b499ec4a2644 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:17.534652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a3990555-a969-4131-af2f-99ac4063a421 req-94474043-5fc7-4d25-b4ba-b499ec4a2644 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:17.534652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a3990555-a969-4131-af2f-99ac4063a421 req-94474043-5fc7-4d25-b4ba-b499ec4a2644 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:17.553844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-a3990555-a969-4131-af2f-99ac4063a421 req-94474043-5fc7-4d25-b4ba-b499ec4a2644 service nova] Creating event network-changed:7063fec6-24ac-4c04-bef3-3f9ee9c54d76 for instance 528c748a-ba74-44e6-b1a7-84ab068acfcb on hv-cinder-85426 Aug 29 21:27:17.561890 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-a3990555-a969-4131-af2f-99ac4063a421 req-94474043-5fc7-4d25-b4ba-b499ec4a2644 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049846 Aug 29 21:27:17.564488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 51/97] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:27:17.684034 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:17.684034 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-17fb8b5f-e264-4bb1-b8a3-4814ec84c781 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.326625 Aug 29 21:27:17.684034 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 47/98] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:17 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:18.312201 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:18.313717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:18.319035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:18.319963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.320500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:18.322267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.322774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.323204 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.324036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.324487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.324908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.327919 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.328646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.329296 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.330136 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.330803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.331424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.355707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.527290 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:18.540692 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8e79f753-a465-4aa2-9a7c-08a9f1946eb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.233045 Aug 29 21:27:18.543337 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 52/99] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:18 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:18.548451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:18.561898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-506b5ee2-77ea-4339-a805-5d059a805005 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.246270 Aug 29 21:27:18.564476 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 48/100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:18 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:18.567717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:18.568363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:18.575465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.576233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.576833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.577548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.577997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.579138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.704272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:18.705253 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:18.715076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.716578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.717219 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.718151 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:18.719395 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:18.720262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:18.747718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:18.755803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4666a03e-4efb-43d9-b9a6-55d7292fb630 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.195435 Aug 29 21:27:18.760021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 53/101] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:18 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:18.971465 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:18.979376 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dd83e524-5fa1-44d2-9774-c1ecce5ea2a3 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.281728 Aug 29 21:27:18.979986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 49/102] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:18 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:19.105560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-1f614ce0-4167-4663-9e8c-c1c2e809e1f4 req-641aa4c6-d030-439e-8cbf-d46a867d3893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5c96ac-f97f-448f-beca-9f9caa324e64", "name": "network-vif-plugged", "status": "completed", "tag": "eba29033-b888-4888-a4cd-c1d7388e8109"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:19.118896 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1f614ce0-4167-4663-9e8c-c1c2e809e1f4 req-641aa4c6-d030-439e-8cbf-d46a867d3893 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:19.119537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1f614ce0-4167-4663-9e8c-c1c2e809e1f4 req-641aa4c6-d030-439e-8cbf-d46a867d3893 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:19.119791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1f614ce0-4167-4663-9e8c-c1c2e809e1f4 req-641aa4c6-d030-439e-8cbf-d46a867d3893 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:19.132794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-1f614ce0-4167-4663-9e8c-c1c2e809e1f4 req-641aa4c6-d030-439e-8cbf-d46a867d3893 service nova] Creating event network-vif-plugged:eba29033-b888-4888-a4cd-c1d7388e8109 for instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 on hv-cinder-85426 Aug 29 21:27:19.138171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-1f614ce0-4167-4663-9e8c-c1c2e809e1f4 req-641aa4c6-d030-439e-8cbf-d46a867d3893 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232681 Aug 29 21:27:19.138982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 54/103] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:27:19.563833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:19.565382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:19.572970 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:19.577769 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:19.585260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:19.586893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:19.591967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:19.593999 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:19.596947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:19.597672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:19.598307 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:19.603718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:19.604430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:19.615041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:19.615041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:19.615041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:19.791298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:19.806558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ad87fefe-338e-4f47-bad2-fdaa3982ab68 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.225223 Aug 29 21:27:19.806948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 55/104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:19 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:19.812369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:19.814119 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:19.817494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:19.821237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:19.821821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:19.822329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:19.823102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:19.823857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:19.824460 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:19.825555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-edeb40e3-2212-47e7-8117-02dd32655411 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.266750 Aug 29 21:27:19.826365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 50/105] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:19 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:19.966964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:19.979109 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6d8ed117-6b2e-4fab-bf7d-56f9c79a2c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.170599 Aug 29 21:27:19.980238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 56/106] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:19 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:20.004909 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:20.005677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:20.012561 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:20.017353 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:20.018198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:20.018933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:20.020417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:20.020858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:20.238707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:20.248881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c7ddfc49-e4d3-4337-a271-7a3cad407723 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.248297 Aug 29 21:27:20.255093 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 51/107] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:19 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:20.831871 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:20.832825 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:20.843482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:20.845058 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:20.846498 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:20.846835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:20.847451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:20.849659 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:20.852437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:20.853229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:20.854837 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:20.855828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:20.856457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:20.857338 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:20.857984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:20.858405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:21.047967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:21.058043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:21.070507 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9edac671-384a-49c1-99ae-d64756380394 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.245343 Aug 29 21:27:21.071763 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 57/108] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:20 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:21.072485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ce7ecf69-c34b-47f1-ba90-41fc90aa7b99 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.229607 Aug 29 21:27:21.075527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 52/109] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:20 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:21.081878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:21.082703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:21.102597 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:21.103100 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:21.103539 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:21.104288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:21.104727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:21.107719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:21.159252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-573f4f8f-b14a-4655-a873-6d9aacd9d3e5 req-6d27f8fe-2114-4bd2-b03e-28f4ba921d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b9b318-ba34-455a-90b9-4ff5619fa02e", "name": "network-vif-plugged", "status": "completed", "tag": "9038f059-1399-4f98-9ce3-88cce7cf0565"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:21.169317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-573f4f8f-b14a-4655-a873-6d9aacd9d3e5 req-6d27f8fe-2114-4bd2-b03e-28f4ba921d88 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:21.170036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-573f4f8f-b14a-4655-a873-6d9aacd9d3e5 req-6d27f8fe-2114-4bd2-b03e-28f4ba921d88 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:21.170610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-573f4f8f-b14a-4655-a873-6d9aacd9d3e5 req-6d27f8fe-2114-4bd2-b03e-28f4ba921d88 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:21.184430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-573f4f8f-b14a-4655-a873-6d9aacd9d3e5 req-6d27f8fe-2114-4bd2-b03e-28f4ba921d88 service nova] Creating event network-vif-plugged:9038f059-1399-4f98-9ce3-88cce7cf0565 for instance 28b9b318-ba34-455a-90b9-4ff5619fa02e on hv-cinder-85426 Aug 29 21:27:21.189770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-573f4f8f-b14a-4655-a873-6d9aacd9d3e5 req-6d27f8fe-2114-4bd2-b03e-28f4ba921d88 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 Aug 29 21:27:21.191002 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 58/110] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:21.274198 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:21.275299 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:21.285260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:21.286598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:21.287156 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:21.288025 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:21.288991 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:21.289640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:21.296033 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:21.313145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4fc5bccf-a845-4d34-85d3-91b1d7523c40 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.236061 Aug 29 21:27:21.314168 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 53/111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:21 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:21.694906 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:21.706144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c0f352d8-a4d2-4e9e-8208-7636674484cb tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.439208 Aug 29 21:27:21.706948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 59/112] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:21 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:22.095438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:22.096690 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:22.097042 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:22.097137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:22.102824 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.103741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.104353 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.105057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.105506 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.105920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.106047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.106820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.107537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.109977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.109977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.119459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.295337 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:22.307757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0568c85f-75a3-4555-8e8c-e349a99654e7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.216629 Aug 29 21:27:22.308690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 54/113] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:22 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:22.343246 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:22.347796 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:22.363092 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.366481 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.367037 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.368282 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.369110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.369904 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.370267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:22.381795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-51376e83-d851-422d-8794-2881c0031c54 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.290088 Aug 29 21:27:22.383403 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 60/114] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:22 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:22.611969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:22.621841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-180fe7f9-7a67-4490-89b7-a2c8bebc777d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.290462 Aug 29 21:27:22.622562 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 55/115] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:22 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:22.728654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:22.740967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:22.740967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.740967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.740967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.741318 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:22.741318 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:22.741318 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:22.920475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:22.929333 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a0248db6-5c9f-4dd4-89a4-1a33ff3d9540 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1315 microversion: 2.1 time: 0.204720 Aug 29 21:27:22.940594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 61/116] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:22 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:23.215787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-954f1c4e-c4fd-472c-b9b9-b88e2cd6eb2d req-4d812584-56c7-4ead-adc7-c6e70b1d4f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37678b50-656d-49b5-8f7a-5059a89f458d", "name": "network-vif-plugged", "status": "completed", "tag": "97d85e67-a7e1-4cc9-a19b-75eb2eaacfe5"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:23.234077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-954f1c4e-c4fd-472c-b9b9-b88e2cd6eb2d req-4d812584-56c7-4ead-adc7-c6e70b1d4f25 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.234635 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-954f1c4e-c4fd-472c-b9b9-b88e2cd6eb2d req-4d812584-56c7-4ead-adc7-c6e70b1d4f25 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.235246 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-954f1c4e-c4fd-472c-b9b9-b88e2cd6eb2d req-4d812584-56c7-4ead-adc7-c6e70b1d4f25 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.252832 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-954f1c4e-c4fd-472c-b9b9-b88e2cd6eb2d req-4d812584-56c7-4ead-adc7-c6e70b1d4f25 service nova] Creating event network-vif-plugged:97d85e67-a7e1-4cc9-a19b-75eb2eaacfe5 for instance 37678b50-656d-49b5-8f7a-5059a89f458d on hv-cinder-85426 Aug 29 21:27:23.261313 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-954f1c4e-c4fd-472c-b9b9-b88e2cd6eb2d req-4d812584-56c7-4ead-adc7-c6e70b1d4f25 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051132 Aug 29 21:27:23.262525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 56/117] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:23.330414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:23.331800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:23.339800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.340468 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.341232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.342832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.346548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.346548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.407554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:23.408276 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:23.415320 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.416409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.417073 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.421083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.421083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.421083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.519256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:23.528118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ae333b20-39d2-4daa-88b2-f42e95681972 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.202914 Aug 29 21:27:23.528693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 62/118] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:23 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:23.608198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:23.620173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-881b5ee8-842e-4e21-bc5d-9c82de63ef74 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.216707 Aug 29 21:27:23.620977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 57/119] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:23 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:23.657660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:23.658404 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:23.673421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.673908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.676452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.677418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.678161 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.678798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.842106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:23.851223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a3c49d2b-19f0-4e36-b257-e761dc85dafa tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.197861 Aug 29 21:27:23.865988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 63/120] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:23 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:23.955543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:23.956387 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:23.963386 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.964006 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.964901 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:23.965369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:23.965844 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:23.966401 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:24.139256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:24.148258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5a4f76c2-917d-4d28-9c53-9c72d5af37c2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1502 microversion: 2.1 time: 0.197375 Aug 29 21:27:24.149124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 58/121] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:23 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:24.554708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:24.555304 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:24.561371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:24.561844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:24.562753 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:24.563671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:24.563903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:24.564315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:24.642303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:24.642955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:24.649348 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:24.649749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:24.650275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:24.650875 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:24.651327 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:24.651744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:24.706206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:24.714093 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d7f8bc14-a638-4a33-be3a-5cf35c4171b2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.163181 Aug 29 21:27:24.714844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 64/122] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:24 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:24.796306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:24.804675 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ac0d7b54-6426-4bdc-8415-7d537e1627a9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.166927 Aug 29 21:27:24.805235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 59/123] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:24 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:24.874277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:24.874909 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:24.881075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:24.881785 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:24.882235 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:24.882914 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:24.883361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:24.883775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:25.039427 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:25.042879 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-027a1c3d-0ddf-4dbc-8487-d7faea723f38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.172241 Aug 29 21:27:25.043540 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 65/124] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:24 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:25.280086 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-d5c0d280-39fe-4c6f-a8fe-d45fc9df1933 req-3d6b9de7-be3e-4732-ac83-eab13688760c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979806e6-6c73-40b1-a798-731653815edc", "name": "network-vif-plugged", "status": "completed", "tag": "32eade43-2044-402f-ab19-8fcb425b1b8a"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:25.289650 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d5c0d280-39fe-4c6f-a8fe-d45fc9df1933 req-3d6b9de7-be3e-4732-ac83-eab13688760c service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:25.290123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d5c0d280-39fe-4c6f-a8fe-d45fc9df1933 req-3d6b9de7-be3e-4732-ac83-eab13688760c service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:25.290633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d5c0d280-39fe-4c6f-a8fe-d45fc9df1933 req-3d6b9de7-be3e-4732-ac83-eab13688760c service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:25.301926 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-d5c0d280-39fe-4c6f-a8fe-d45fc9df1933 req-3d6b9de7-be3e-4732-ac83-eab13688760c service nova] Creating event network-vif-plugged:32eade43-2044-402f-ab19-8fcb425b1b8a for instance 979806e6-6c73-40b1-a798-731653815edc on hv-cinder-85426 Aug 29 21:27:25.306871 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-d5c0d280-39fe-4c6f-a8fe-d45fc9df1933 req-3d6b9de7-be3e-4732-ac83-eab13688760c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030405 Aug 29 21:27:25.307446 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 60/125] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:25.735792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:25.736436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:25.742470 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:25.742952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:25.743386 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:25.744117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:25.744567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:25.744988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:25.825797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:25.826556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:25.833929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:25.834394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:25.834825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:25.835528 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:25.836260 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:25.836676 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:25.882382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:25.890975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b82d6750-28cd-4a0b-899a-6a2a2fe77382 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.158467 Aug 29 21:27:25.891556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 66/126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:25 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:25.993048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:26.001705 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4e887394-b37c-4cd3-93e3-c7a7d30787cb tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.180108 Aug 29 21:27:26.002256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 61/127] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:25 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:26.064908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:26.065792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:26.073162 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:26.073841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:26.074551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:26.075972 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:26.076761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:26.077484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:26.259062 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:26.270346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-27f3a046-3f6e-4261-b6e3-8618a216372d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.209965 Aug 29 21:27:26.271014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 67/128] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:26 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:26.912835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:26.913480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:26.919613 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:26.920124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:26.920555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:26.921249 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:26.922239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:26.922759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.025268 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:27.026272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:27.034812 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:27.035443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:27.036056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.036985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:27.037571 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:27.038089 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.100819 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:27.118309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0d973905-c780-4248-bd53-3113ad122205 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.209363 Aug 29 21:27:27.121191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 62/129] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:26 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:27.271428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:27.278446 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ca44c979-868f-4738-9be6-2142e8c56ca6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.257236 Aug 29 21:27:27.278446 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 68/130] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:27 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:27.287860 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "911181fe-5119-43c6-886e-877c2962c5ed"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:27.291938 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:27.297142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:27.297799 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:27.300670 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:27.308394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:27.308394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.308394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:27.308394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:27.308668 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.308746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:27.308746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:27.308746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.308746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:27.309007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:27.309007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.333064 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:27.499399 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:27.508096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3e22cced-77ef-4de0-8f06-29714e24dcaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.216667 Aug 29 21:27:27.508951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 69/131] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:27 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:27.513568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-1d5eb275-9566-49d1-a9c9-1edd44993e0d req-5856cf00-6584-4614-8ebf-2dcddd96122f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528c748a-ba74-44e6-b1a7-84ab068acfcb", "name": "network-vif-plugged", "status": "completed", "tag": "7063fec6-24ac-4c04-bef3-3f9ee9c54d76"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:27.523455 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1d5eb275-9566-49d1-a9c9-1edd44993e0d req-5856cf00-6584-4614-8ebf-2dcddd96122f service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:27.523955 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1d5eb275-9566-49d1-a9c9-1edd44993e0d req-5856cf00-6584-4614-8ebf-2dcddd96122f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:27.524387 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1d5eb275-9566-49d1-a9c9-1edd44993e0d req-5856cf00-6584-4614-8ebf-2dcddd96122f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:27.535795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-1d5eb275-9566-49d1-a9c9-1edd44993e0d req-5856cf00-6584-4614-8ebf-2dcddd96122f service nova] Creating event network-vif-plugged:7063fec6-24ac-4c04-bef3-3f9ee9c54d76 for instance 528c748a-ba74-44e6-b1a7-84ab068acfcb on hv-cinder-85426 Aug 29 21:27:27.541252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-1d5eb275-9566-49d1-a9c9-1edd44993e0d req-5856cf00-6584-4614-8ebf-2dcddd96122f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031098 Aug 29 21:27:27.541862 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 70/132] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:28.147075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:28.147763 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:28.153919 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:28.154455 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:28.154880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:28.155551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:28.156081 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:28.157689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:28.431714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:28.439684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e5c6921d-4598-499b-bc42-11d40f3c7e17 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1322 microversion: 2.1 time: 0.296843 Aug 29 21:27:28.440271 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 71/133] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:28 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:28.453434 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:28.454399 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:28.460612 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:28.461570 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:28.461993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:28.462672 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:28.463111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:28.463680 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:28.627813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:28.635477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ead276f5-6d0e-41f9-9d5a-d0f3d0e6dd3c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.185974 Aug 29 21:27:28.636189 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 72/134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:28 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:28.641378 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:28.641986 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:28.647935 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:28.648666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:28.649252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:28.650210 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:28.650666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:28.651098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:28.784621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:28.793509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-eea48a58-2d3c-432b-a66d-2dffa5fdbe5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.156267 Aug 29 21:27:28.794092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 73/135] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:28 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:29.462990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:29.466040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:29.473424 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:29.479569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:29.480354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:29.481334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:29.481989 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:29.482971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:29.654875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:29.663273 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6694c501-0e62-4d26-8624-72efd034cad9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1513 microversion: 2.1 time: 0.205963 Aug 29 21:27:29.663835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 74/136] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:29 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:29.668213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:29.668801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:29.674431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:29.674898 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:29.675354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:29.676066 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:29.676513 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:29.677090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:29.812684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:29.820538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-eda4f07c-8ea0-4f87-ac81-16dbcac0e916 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.155731 Aug 29 21:27:29.821098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 75/137] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:29 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:29.826897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:29.829778 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:29.839851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:29.840794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:29.841169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:29.841936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:29.842385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:29.842808 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:29.907532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'flavor' on Instance uuid 37678b50-656d-49b5-8f7a-5059a89f458d {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:27:30.056412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4438354c-15b1-4a5e-ad9d-accd6f8dd609 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "POST /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.773324 Aug 29 21:27:30.060807 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 63/138] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:27:27 2022] POST /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64/os-volume_attachments => generated 194 bytes in 2775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:30.062600 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:30.063329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:30.069554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:30.070033 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:30.070461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:30.071207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:30.071626 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:30.072085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:30.221522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:30.229139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f36abc7b-b197-4862-be96-7e3c51e02a3c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.170592 Aug 29 21:27:30.229706 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 64/139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:30 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:30.445014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2a2d8e2f-e56f-4588-aeee-c847e2c9d3e0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d/action" status: 200 len: 32 microversion: 2.1 time: 0.621847 Aug 29 21:27:30.445560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 76/140] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:27:29 2022] POST /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d/action => generated 32 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:27:30.455370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:30.456021 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:30.462451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:30.462933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:30.463367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:30.464086 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:30.464538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:30.464959 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:30.467787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.619432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:30.629331 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9fda4f6e-af52-4d6b-b8c9-fb24a1a0dc8c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.176854 Aug 29 21:27:30.640449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 65/141] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:30 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:30.843440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:30.844646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:30.850671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:30.851215 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:30.851645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:30.852375 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:30.852818 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:30.854621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:30.989123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:30.996830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1c99f614-ec55-4d57-ac6c-80f79b859756 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.157982 Aug 29 21:27:30.997396 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 77/142] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:30 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:31.250433 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:31.250996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:31.258362 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:31.258859 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:31.259297 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:31.260047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:31.260504 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:31.260955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:31.396066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:31.403530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1b6baad9-b85a-42d5-bb3f-12b22c148236 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.157621 Aug 29 21:27:31.404121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 66/143] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:31 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:31.650248 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:31.651041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:31.662626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:31.663123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:31.663542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:31.664272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:31.671268 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:31.671268 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:31.810000 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:31.817970 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f1ba8122-d82b-404d-abca-10fc6bee2729 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.171758 Aug 29 21:27:31.818547 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 78/144] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:31 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:32.018321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:32.018927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:32.022014 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:32.025762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:32.026242 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:32.026678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:32.027370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:32.027822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:32.028276 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:32.181551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:32.191133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1bf90371-2b43-49bf-a190-e44b5182977c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1366 microversion: 2.1 time: 0.177159 Aug 29 21:27:32.203928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 67/145] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:32 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:32.424651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:32.431283 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:32.431394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:32.431857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:32.432322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:32.433018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:32.433478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:32.433932 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:32.570671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:32.578911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-354d7503-95f6-4c31-a4de-406f060a2ed8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.158591 Aug 29 21:27:32.579484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 79/146] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:32 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:32.850500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:32.851271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:32.858620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:32.859056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:32.859696 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:32.860460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:32.860940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:32.861599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:32.995360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:33.004162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ae62ab02-7373-4ddf-a5e3-3a07bfd7673e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.168455 Aug 29 21:27:33.004977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 68/147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:32 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:33.213182 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:33.213803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:33.220472 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:33.221013 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:33.221435 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:33.222109 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:33.222549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:33.222978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:33.362842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:33.370665 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2b377b6f-4749-4002-8fe1-cb1817b25545 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1557 microversion: 2.1 time: 0.161714 Aug 29 21:27:33.371238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 80/148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:33 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:33.392479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:33.392892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:33.399540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:33.400061 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:33.400493 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:33.401183 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:33.401634 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:33.402058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:33.482110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-36ebdd50-d5b1-4e20-8275-ff03f6c5c172 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093965 Aug 29 21:27:33.482707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 69/149] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:27:33 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:33.602616 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:33.603585 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:33.610773 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:33.611252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:33.611681 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:33.612436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:33.612887 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:33.613496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:33.880209 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:33.925020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d69188e8-f89f-4260-80f7-93cab2bdb1ac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.295645 Aug 29 21:27:33.925020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 81/150] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:33 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:34.027386 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:34.028035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:34.035022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:34.035516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:34.035977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:34.037005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:34.037459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:34.038518 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:34.187015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:34.195475 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d33c4067-2e85-4395-9cf9-a155c79f79d8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.172188 Aug 29 21:27:34.196419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 70/151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:34 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:34.946569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:34.948162 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:34.957793 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:34.958787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:34.959564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:34.960792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:34.962035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:34.962776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:35.175471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-503d57d2-bae5-4ba9-80c2-ac7487b5bb5b req-6fbb9426-5fb2-4d85-8cfa-f90be98a189a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979806e6-6c73-40b1-a798-731653815edc", "tag": "32eade43-2044-402f-ab19-8fcb425b1b8a"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:35.186497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-503d57d2-bae5-4ba9-80c2-ac7487b5bb5b req-6fbb9426-5fb2-4d85-8cfa-f90be98a189a service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:35.187150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-503d57d2-bae5-4ba9-80c2-ac7487b5bb5b req-6fbb9426-5fb2-4d85-8cfa-f90be98a189a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:35.187685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-503d57d2-bae5-4ba9-80c2-ac7487b5bb5b req-6fbb9426-5fb2-4d85-8cfa-f90be98a189a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:35.199088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-503d57d2-bae5-4ba9-80c2-ac7487b5bb5b req-6fbb9426-5fb2-4d85-8cfa-f90be98a189a service nova] Creating event network-changed:32eade43-2044-402f-ab19-8fcb425b1b8a for instance 979806e6-6c73-40b1-a798-731653815edc on hv-cinder-85426 Aug 29 21:27:35.204388 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-503d57d2-bae5-4ba9-80c2-ac7487b5bb5b req-6fbb9426-5fb2-4d85-8cfa-f90be98a189a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Aug 29 21:27:35.205754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 71/152] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:27:35.213992 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:35.223253 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-18b96ed9-6941-411c-9530-537fc05e9df2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1362 microversion: 2.1 time: 0.282522 Aug 29 21:27:35.223526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:35.223842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 82/153] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:34 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:35.224702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:35.231226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:35.231740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:35.232259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:35.232972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:35.233448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:35.237443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:35.379709 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:35.388104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c7bb9c14-379e-47c1-bf4b-edd33995113e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.169307 Aug 29 21:27:35.388998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 72/154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:35 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:36.249170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:36.249968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:36.256210 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:36.256691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:36.257126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:36.257820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:36.258266 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:36.258688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:36.392847 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:36.402973 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-042300d3-7597-4610-b4be-1ae374dc9aa6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1548 microversion: 2.1 time: 0.157661 Aug 29 21:27:36.444203 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 83/155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:36 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:36.444878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:36.444878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:36.444878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:36.444878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:36.445478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:36.445478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:36.445478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:36.445478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:36.445748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:36.445748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:36.445748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:36.445748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:36.446044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:36.446044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:36.446044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:36.446567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:36.654195 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4051fcec-475f-4c17-a1df-211c305f6d63 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233569 Aug 29 21:27:36.654777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 84/156] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:27:36 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:37.000825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:37.009227 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-06859e7a-28d0-43c5-a6d5-142a40b4ae84 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.601944 Aug 29 21:27:37.011595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 73/157] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:36 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:38.036708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:38.037934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:38.045030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:38.045517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:38.045948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:38.046689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:38.047134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:38.047740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:38.052230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:38.203688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:38.217180 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c9f89aff-8feb-41cc-afef-d24a371933a3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.184244 Aug 29 21:27:38.217754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 85/158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:38 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:38.455647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-19adeec5-f7f6-4416-95da-07de299f3bf6 req-533a3264-b386-4f2c-9fb8-f64cf8fb7822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528c748a-ba74-44e6-b1a7-84ab068acfcb", "tag": "7063fec6-24ac-4c04-bef3-3f9ee9c54d76"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:38.466146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-19adeec5-f7f6-4416-95da-07de299f3bf6 req-533a3264-b386-4f2c-9fb8-f64cf8fb7822 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:38.466833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-19adeec5-f7f6-4416-95da-07de299f3bf6 req-533a3264-b386-4f2c-9fb8-f64cf8fb7822 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:38.467602 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-19adeec5-f7f6-4416-95da-07de299f3bf6 req-533a3264-b386-4f2c-9fb8-f64cf8fb7822 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:38.480815 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-19adeec5-f7f6-4416-95da-07de299f3bf6 req-533a3264-b386-4f2c-9fb8-f64cf8fb7822 service nova] Creating event network-changed:7063fec6-24ac-4c04-bef3-3f9ee9c54d76 for instance 528c748a-ba74-44e6-b1a7-84ab068acfcb on hv-cinder-85426 Aug 29 21:27:38.488872 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-19adeec5-f7f6-4416-95da-07de299f3bf6 req-533a3264-b386-4f2c-9fb8-f64cf8fb7822 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037288 Aug 29 21:27:38.489485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 74/159] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:39.239287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:39.240022 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:39.250246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:39.251175 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:39.255193 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:39.256028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:39.256499 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:39.256931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:39.393417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:39.401711 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-573061ed-4c03-4879-a4a5-5a853810c83f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.166245 Aug 29 21:27:39.402437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 86/160] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:39 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:40.424156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:40.424858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:40.433805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:40.434956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:40.434956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:40.435449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:40.435913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:40.436611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:40.576204 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:40.584592 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5ae74943-26a9-4b59-9109-55b954e37d66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.165652 Aug 29 21:27:40.585157 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 75/161] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:40 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:41.610062 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:41.611299 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:41.618511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:41.619000 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:41.619442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:41.620216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:41.620660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:41.621082 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:41.760440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:41.768160 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ef837824-0802-4e89-85cb-b86764434f47 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.162149 Aug 29 21:27:41.769057 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 87/162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:41 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:42.789419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:42.790028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:42.796961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:42.797445 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:42.797876 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:42.798607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:42.799079 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:42.799633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:42.932088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:42.940677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f4fce2dd-9dda-4d9d-943f-05d57bbf09d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.155110 Aug 29 21:27:42.941258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 76/163] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:42 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:43.965364 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:43.965364 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:43.972484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:43.972928 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:43.973418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:43.973851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:43.974548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:43.974996 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:43.975583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:44.136037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:44.145988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-18f73657-5cd0-4b95-b5a1-2d8137ef88fa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.187494 Aug 29 21:27:44.146636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 88/164] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:43 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:45.168007 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:45.168644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:45.176569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:45.177313 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:45.177740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:45.178441 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:45.178887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:45.179301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:45.324624 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:45.332533 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-bdce8f6e-c383-4a54-91e1-9225cd67c56c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.168651 Aug 29 21:27:45.333114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 77/165] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:45 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:45.745161 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:45.745645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:45.752574 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:45.753061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:45.753496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:45.754209 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:45.754666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:45.755085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:45.782328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:27:46.195065 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9f216964-0698-484e-b996-16ad4f6d9d80 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 204 len: 0 microversion: 2.1 time: 0.453464 Aug 29 21:27:46.195660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 89/166] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:27:45 2022] DELETE /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:46.203909 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:46.205704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:46.247551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:46.248101 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:46.248531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:46.249308 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:46.249857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:46.250578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:46.354895 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:46.355586 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:46.361748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:46.362231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:46.362852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:46.363344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:46.363848 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:46.364301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:46.378786 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:46.387611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ca5b36b8-11e5-4961-8dbf-0551ed6d30e7 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1554 microversion: 2.1 time: 0.187581 Aug 29 21:27:46.388270 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 78/167] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:46 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:46.501656 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:46.509993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-536175bb-32df-456f-9099-0c17895e47e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.159262 Aug 29 21:27:46.510567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 90/168] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:46 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:47.408278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:47.408886 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:47.415713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:47.416240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:47.416675 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:47.417366 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:47.417821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:47.418248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:47.530743 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:47.531293 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:47.537751 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:47.538242 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:47.538691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:47.539407 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:47.539852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:47.540295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:47.551715 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:47.560359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0261cbac-a46f-429a-9b25-4b243e3e657e tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1554 microversion: 2.1 time: 0.155878 Aug 29 21:27:47.560948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 79/169] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:47 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:47.669398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:47.677167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f0558498-f75e-4c0d-87f0-d44ec3ac9845 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.150422 Aug 29 21:27:47.677752 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 91/170] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:47 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:48.581971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:48.582595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:48.589348 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:48.589838 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:48.590265 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:48.590953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:48.591399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:48.591814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:48.699140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:48.699736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:48.706456 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:48.706982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:48.707390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:48.708110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:48.711324 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:48.711324 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:48.736180 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:48.745390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4e39ff4a-fb78-4e20-ac8a-5fc402766670 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1554 microversion: 2.1 time: 0.167765 Aug 29 21:27:48.746169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 80/171] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:48 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:48.846099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:48.855598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ce396695-e64d-4519-a7b7-b26deffcd5c8 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.159185 Aug 29 21:27:48.855598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 92/172] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:48 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:49.768414 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:49.769047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:49.775751 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:49.776279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:49.776717 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:49.777421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:49.777875 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:49.778299 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:49.877507 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:49.879730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:49.885828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:49.886315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:49.886743 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:49.887467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:49.888138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:49.888721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:49.919569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:49.930589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-efcd39bf-06ea-4d96-898e-7b61725a1e03 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1554 microversion: 2.1 time: 0.166939 Aug 29 21:27:49.931336 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 81/173] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:49 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:50.034265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:50.042605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-690f5509-c264-4e73-82d8-605093f2a719 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.169417 Aug 29 21:27:50.043498 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 93/174] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:49 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:50.952441 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:50.954094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:50.962677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:50.963161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:50.963597 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:50.964442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:50.964883 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:50.965306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:51.065041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:51.065709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:51.072902 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:51.073383 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:51.073881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:51.074767 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:51.075416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:51.075844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:51.118464 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:51.135321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-fc2477d5-1916-4754-996e-cd8420cd6d9a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1554 microversion: 2.1 time: 0.186930 Aug 29 21:27:51.135980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 82/175] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:50 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:51.212128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:51.219855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e6e746fd-cb1c-4685-a04c-cccec8ec6f70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.159257 Aug 29 21:27:51.220447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 94/176] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:51 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:52.157547 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:52.158247 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:52.164815 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:52.165293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:52.165724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:52.166429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:52.166878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:52.167303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:52.188873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:52.243480 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:52.244264 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:52.250597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:52.251086 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:52.251520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:52.252242 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:52.253117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:52.253724 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:52.286071 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:52.296339 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9e899296-0f01-473d-90ba-0ca5ba7ba4a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1512 microversion: 2.1 time: 0.142976 Aug 29 21:27:52.296954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 83/177] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:52 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:52.349499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-e8471c34-a573-45a8-9f8d-5ea8e3b79a7a req-c5b09238-7c6b-4200-839a-49faecadd319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5c96ac-f97f-448f-beca-9f9caa324e64", "name": "network-vif-deleted", "tag": "eba29033-b888-4888-a4cd-c1d7388e8109"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:52.367839 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-e8471c34-a573-45a8-9f8d-5ea8e3b79a7a req-c5b09238-7c6b-4200-839a-49faecadd319 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:52.368464 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-e8471c34-a573-45a8-9f8d-5ea8e3b79a7a req-c5b09238-7c6b-4200-839a-49faecadd319 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:52.368889 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-e8471c34-a573-45a8-9f8d-5ea8e3b79a7a req-c5b09238-7c6b-4200-839a-49faecadd319 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:52.381845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-e8471c34-a573-45a8-9f8d-5ea8e3b79a7a req-c5b09238-7c6b-4200-839a-49faecadd319 service nova] Creating event network-vif-deleted:eba29033-b888-4888-a4cd-c1d7388e8109 for instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 on hv-cinder-85426 Aug 29 21:27:52.387563 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-e8471c34-a573-45a8-9f8d-5ea8e3b79a7a req-c5b09238-7c6b-4200-839a-49faecadd319 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041666 Aug 29 21:27:52.388690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 84/178] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:52.439572 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:52.447237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6347c608-43a4-425e-b3b3-bf7c9dfd18fc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.208925 Aug 29 21:27:52.448989 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 95/179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:52 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:53.322793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:53.323498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:53.330877 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:53.331366 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:53.332004 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:53.332707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:53.333160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:53.333582 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:53.367596 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:53.368115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:53.368545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:53.368998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lazy-loading 'fault' on Instance uuid 1b5c96ac-f97f-448f-beca-9f9caa324e64 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:27:53.414541 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:53.422738 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-73591992-0b25-42e3-a813-e7eaddf8ece4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1351 microversion: 2.1 time: 0.105382 Aug 29 21:27:53.423324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 85/180] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:53 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:53.471298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:53.472496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:53.480373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:53.480373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:53.480373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:53.480589 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:53.481096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:53.481757 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:53.614833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:53.622796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1f0d3ea7-95fb-4769-8603-4be3ebee596d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.156046 Aug 29 21:27:53.623369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 96/181] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:53 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:54.443651 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:54.444968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:54.453419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:54.453888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:54.454561 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:54.455288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:54.455751 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:54.456204 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:54.493844 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:54.494332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:54.494867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:54.495415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lazy-loading 'fault' on Instance uuid 1b5c96ac-f97f-448f-beca-9f9caa324e64 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:27:54.540688 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:54.550182 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9c733c74-1ef0-454b-9093-5db32f0270de tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1351 microversion: 2.1 time: 0.110795 Aug 29 21:27:54.556452 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 86/182] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:54 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:54.645978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:54.646578 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:54.653145 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:54.653627 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:54.654058 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:54.654861 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:54.655314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:54.656010 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:54.794275 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:54.802107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bb1ccda6-e721-45a3-a0c3-0d74adf173bc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.159945 Aug 29 21:27:54.802682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 97/183] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:54 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:55.576080 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:55.576699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:55.583728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:55.584559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:55.585396 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:55.586115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:55.586874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:55.587310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:55.623087 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:55.623569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:55.624035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:55.656626 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lazy-loading 'fault' on Instance uuid 1b5c96ac-f97f-448f-beca-9f9caa324e64 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:27:55.666607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:55.675409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-fda69c72-60bb-46d9-b024-fa3a7deea241 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1351 microversion: 2.1 time: 0.103204 Aug 29 21:27:55.676000 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 87/184] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:55 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:55.822891 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:55.823586 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:55.834109 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:55.834605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:55.835032 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:55.850609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:55.850609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:55.850609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:55.965796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:55.973742 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e9ddf20d-a5e5-4263-a066-8eb9fb9b17ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.154792 Aug 29 21:27:55.974312 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 98/185] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:55 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:56.694861 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:56.695521 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:56.706894 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:56.707470 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:56.707824 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:56.708555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:56.709170 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:56.709597 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:56.748422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:56.749158 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:56.751519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:56.751519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lazy-loading 'fault' on Instance uuid 1b5c96ac-f97f-448f-beca-9f9caa324e64 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:27:56.799054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:56.807587 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-342cae48-e8ba-4fcd-8335-d1dbe02887c0 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1351 microversion: 2.1 time: 0.116455 Aug 29 21:27:56.808201 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 88/186] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:56 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:56.994819 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:56.995400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:57.001652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:57.002132 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:57.002561 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:57.003251 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:57.003697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:57.004173 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:57.150655 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:57.158316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-adb0b010-af32-48be-bea5-aa74a1faaeb4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.167372 Aug 29 21:27:57.159273 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 99/187] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:56 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:57.828963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:57.829744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:57.838010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:57.838624 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:57.839312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:57.844920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:57.844920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:57.844920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:57.878231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:57.878851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:57.879282 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:57.879723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lazy-loading 'fault' on Instance uuid 1b5c96ac-f97f-448f-beca-9f9caa324e64 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:27:57.926823 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e135d9b5894147e6a391d75d8896f094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c852db97ba734c7088df6af689b41d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:57.934663 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9beb261d-5c53-4c34-8985-f53710589a1a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 200 len: 1305 microversion: 2.1 time: 0.110347 Aug 29 21:27:57.935777 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 89/188] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:57 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:58.181532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:58.182256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:58.189740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:58.190264 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:58.190698 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:58.191412 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:58.191866 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:58.192324 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:58.196948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:58.362612 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:58.370638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-56a07699-363b-48a2-9688-683e7b2b0c95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.193273 Aug 29 21:27:58.371281 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 100/189] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:58 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:58.956232 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:58.956830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:58.963989 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:58.964478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:58.964915 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:58.965612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:58.966066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:58.966495 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:58.981734 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] HTTP exception thrown: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Request method failure captured: Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 HTTP/1.1 Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8SnZsyMToWuDWnDWZbWWxVG6CB9TeXnrXmKUKNV-uQH5Py83raXM4zFGwWCv1NbxU1qQAMnbCS83XC1t1EHTi6Mjm3B-AgjAdTmd01ijr6MO7mbdTQo9MBEkrYutPle9qzitsgAb2Gh4F6IExmhbf26WzG9T7uWJFTbGp42X6kIwM Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:27:58.987099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c852db97ba734c7088df6af689b41d16", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c852db97ba734c7088df6af689b41d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: e135d9b5894147e6a391d75d8896f094 Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:58.988555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '1b5c96ac-f97f-448f-beca-9f9caa324e64'} Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:58.989312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:58.990647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.991651 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Returning 404 to user: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:58.991651 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5a71d862-d46d-47e9-9731-ee322d831f71 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 404 len: 111 microversion: 2.1 time: 0.037211 Aug 29 21:27:58.991651 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 90/190] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:58 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:27:59.106256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:59.108566 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:59.115006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:59.115483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:59.115949 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:59.116628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:59.117075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:59.117503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:59.130889 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] HTTP exception thrown: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Request method failure captured: Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64/os-volume_attachments HTTP/1.1 Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8SnZsyMToWuDWnDWZbWWxVG6CB9TeXnrXmKUKNV-uQH5Py83raXM4zFGwWCv1NbxU1qQAMnbCS83XC1t1EHTi6Mjm3B-AgjAdTmd01ijr6MO7mbdTQo9MBEkrYutPle9qzitsgAb2Gh4F6IExmhbf26WzG9T7uWJFTbGp42X6kIwM Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:27:59.135172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c852db97ba734c7088df6af689b41d16", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c852db97ba734c7088df6af689b41d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: e135d9b5894147e6a391d75d8896f094 Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:59.136769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'server_id': '1b5c96ac-f97f-448f-beca-9f9caa324e64'} Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:59.137520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:27:59.138587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.139845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Returning 404 to user: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:59.139845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e7dcbfe7-d5c5-49bc-bd1b-3b3c394d21e2 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034375 Aug 29 21:27:59.139845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 101/191] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:27:59 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:27:59.393511 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:59.394156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:27:59.400301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:59.400782 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:59.401214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:59.401905 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:27:59.402355 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:27:59.402779 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:27:59.556084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:27:59.564030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8b2a4634-b1e0-4fef-b003-55d4918a84a2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.174991 Aug 29 21:27:59.565727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 91/192] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:27:59 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:00.601036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:00.601503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:00.608174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:00.608859 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:00.610745 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:00.611616 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:00.612381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:00.613217 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:00.756639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:00.764370 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ac052135-5f42-4aa8-b98d-e73e1560e0dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.167910 Aug 29 21:28:00.764948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 102/193] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:00 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:00.857300 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:00.857984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:00.865058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:00.865642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:00.866094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:00.866903 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:00.867358 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:00.867792 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:00.882095 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] HTTP exception thrown: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Request method failure captured: Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 HTTP/1.1 Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8SnZsyMToWuDWnDWZbWWxVG6CB9TeXnrXmKUKNV-uQH5Py83raXM4zFGwWCv1NbxU1qQAMnbCS83XC1t1EHTi6Mjm3B-AgjAdTmd01ijr6MO7mbdTQo9MBEkrYutPle9qzitsgAb2Gh4F6IExmhbf26WzG9T7uWJFTbGp42X6kIwM Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:28:00.883637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c852db97ba734c7088df6af689b41d16", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c852db97ba734c7088df6af689b41d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: e135d9b5894147e6a391d75d8896f094 Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.884896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '1b5c96ac-f97f-448f-beca-9f9caa324e64'} Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:28:00.885625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.886757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.887825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Returning 404 to user: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:28:00.887825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7be17bd0-7c0a-4d0c-b3fe-a25eff32938a tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 404 len: 111 microversion: 2.1 time: 0.034803 Aug 29 21:28:00.887825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 92/194] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:28:00 2022] DELETE /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:28:00.893971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:00.894528 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] [instance: 1b5c96ac-f97f-448f-beca-9f9caa324e64] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:00.900622 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:00.901204 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:00.901522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:00.902214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:00.902658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:00.903074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:00.917061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] HTTP exception thrown: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Request method failure captured: Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 HTTP/1.1 Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8SnZsyMToWuDWnDWZbWWxVG6CB9TeXnrXmKUKNV-uQH5Py83raXM4zFGwWCv1NbxU1qQAMnbCS83XC1t1EHTi6Mjm3B-AgjAdTmd01ijr6MO7mbdTQo9MBEkrYutPle9qzitsgAb2Gh4F6IExmhbf26WzG9T7uWJFTbGp42X6kIwM Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:28:00.919225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c852db97ba734c7088df6af689b41d16", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c852db97ba734c7088df6af689b41d16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c852db97ba734c7088df6af689b41d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: c852db97ba734c7088df6af689b41d16 Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-DeleteServersTestJSON-2048524866 Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: e135d9b5894147e6a391d75d8896f094 Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-DeleteServersTestJSON-2048524866-project Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.920444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '1b5c96ac-f97f-448f-beca-9f9caa324e64'} Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:28:00.921080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. Aug 29 21:28:00.922781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:00.923725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] Returning 404 to user: Instance 1b5c96ac-f97f-448f-beca-9f9caa324e64 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:28:00.923725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-88275d8f-82a8-4882-ad16-794884bd77a4 tempest-DeleteServersTestJSON-2048524866 tempest-DeleteServersTestJSON-2048524866-project] 10.222.0.65 "GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64" status: 404 len: 111 microversion: 2.1 time: 0.030544 Aug 29 21:28:00.923725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 103/195] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:00 2022] GET /compute/v2.1/servers/1b5c96ac-f97f-448f-beca-9f9caa324e64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:28:01.786149 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:01.786766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:01.792961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:01.793672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:01.794352 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:01.795058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:01.795520 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:01.795964 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:02.000376 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:02.016602 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c8f6c9c0-92c3-478e-9ba2-47bc023b51c4 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.235053 Aug 29 21:28:02.017753 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 93/196] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:01 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:03.038193 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:03.038876 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:03.046204 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:03.047271 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:03.047761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:03.048477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:03.048927 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:03.049345 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:03.326813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:03.336320 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5bc911cf-0c98-4f89-b540-211dfc7e5431 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.301836 Aug 29 21:28:03.337390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 104/197] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:03 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:04.358175 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:04.359646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:04.364715 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=63 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:04.370705 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:04.371209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:04.371644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:04.372461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:04.372962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:04.373396 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:04.708031 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:04.717995 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2f106812-11b4-4f6a-bd59-08c63400bc80 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.364185 Aug 29 21:28:04.719152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 94/198] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:04 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:05.741851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:05.742473 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:05.748695 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:05.749189 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:05.749677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:05.750365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:05.750806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:05.751222 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:05.889843 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:05.898192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a64f2a0f-d0f1-4f36-b869-b4dad359e547 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.160616 Aug 29 21:28:05.898756 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 105/199] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:05 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:06.919695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:06.920510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:06.927696 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:06.928214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:06.928639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:06.929329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:06.929779 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:06.940480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:07.078178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:07.086607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6887eda8-f258-4554-9e5d-1e8b10cb10ae tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.171042 Aug 29 21:28:07.087444 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 95/200] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:06 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:08.109448 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:08.110050 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:08.116562 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:08.117043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:08.117781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:08.118739 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:08.119356 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:08.120129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:08.268711 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:08.277264 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7dc24244-3636-4d3c-b51a-628ef9f820cc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.172246 Aug 29 21:28:08.277837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 106/201] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:08 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:09.299008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:09.299693 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:09.307250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:09.307804 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:09.308548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:09.309536 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:09.310605 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:09.311149 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:09.495515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:09.506800 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-682bf4c7-b70f-4515-adf9-ddf579a1e3c5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.212206 Aug 29 21:28:09.507407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 96/202] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:09 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:10.533647 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:10.544232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:10.550781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:10.551852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:10.553189 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:10.554689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:10.555868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:10.556940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:11.030463 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:11.041637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c9ca3df0-d991-4418-808f-3f077c48be28 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.516124 Aug 29 21:28:11.044874 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 107/203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:10 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:12.070537 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:12.071389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:12.078359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:12.078850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:12.079486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:12.083034 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:12.084357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:12.085294 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:12.274620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:12.309452 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-67b76f55-4103-467c-be28-1021ec3c1285 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.243977 Aug 29 21:28:12.324410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 97/204] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:12 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:13.336713 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:13.337646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:13.344526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:13.345085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:13.345604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:13.346359 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:13.346872 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:13.347491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:13.627569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:13.636838 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-368ffa76-4d10-48df-ae02-ee8c0a5ce8d9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.303675 Aug 29 21:28:13.637875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 108/205] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:13 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:14.660151 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:14.664754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:14.672072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:14.672658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:14.673107 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:14.674092 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:14.674564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:14.674997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:14.845207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:14.856154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5bd37470-7954-4a34-a28b-88ff1dc87bce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.201318 Aug 29 21:28:14.870205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 98/206] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:14 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:14.912570 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1c44bbda-24ac-4737-9297-0f9282dff428 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'create', calling method: .version_select at 0x7fc8403a9b80>, body: {"keypair": {"name": "tempest-keypair-1247925955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwZmWb0cQ9K0YESj6u31x5RZZLqjHpbEHf48GIvFdryCoToayTItcyHOpleBZQzlA93rsxhsIRoPqcIxXO48AD+X5lBLIV6SQon7VFdkhjawJxjZhE6Dcyox7HUp7owgA=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:14.929824 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-1c44bbda-24ac-4737-9297-0f9282dff428 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for project 5bc75af3ba6c442889ce29351414e110. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:28:14.936995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-1c44bbda-24ac-4737-9297-0f9282dff428 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for user 0e3f8c861a9c49119fc531e2a159ec9d and project 5bc75af3ba6c442889ce29351414e110. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:28:15.071111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1c44bbda-24ac-4737-9297-0f9282dff428 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.331466 Aug 29 21:28:15.071868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 109/207] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Aug 29 21:28:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 333 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 21:28:15.878075 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:15.878677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:15.885182 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:15.885658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:15.886086 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:15.886779 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:15.887223 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:15.887645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:16.042169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:16.056819 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dcf77a38-3966-4771-b9bb-f8926a1977fd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.182466 Aug 29 21:28:16.068749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 99/208] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:15 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:17.081025 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:17.081633 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:17.083564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:17.096385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:17.096925 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:17.097363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:17.098068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:17.098512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:17.098929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:17.259566 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:17.270389 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ed22c5e7-8129-435f-b828-0f97844f898a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.193149 Aug 29 21:28:17.271233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 110/209] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:17 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:18.292609 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:18.293970 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:18.305229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:18.306029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:18.306471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:18.307191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:18.307646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:18.308232 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:18.346458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:18.497956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:18.521205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-211b0c46-4e45-49cd-8d12-0d1c7db29932 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1519 microversion: 2.1 time: 0.229219 Aug 29 21:28:18.521205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 100/210] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:18 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:18.963232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1811136545", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48dd2592-6ea0-414d-a1c9-f95709b58170"}], "security_groups": [{"name": "tempest-securitygroup--1440318788"}], "key_name": "tempest-keypair-1247925955", "user_data": "}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:19.078844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.network.neutron [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] validate_networks() for [('48dd2592-6ea0-414d-a1c9-f95709b58170', None, None, None, None, None)] {{(pid=121558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:28:19.500698 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Flavor limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:28:19.501243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Image limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:28:19.501805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Flavor pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:28:19.502347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Image pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:28:19.502736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:28:19.512113 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:19.512411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:19.513157 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:19.514049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:19.514568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:19.515821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:19.538483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:19.539250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:19.539806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for project 5bc75af3ba6c442889ce29351414e110. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:28:19.543938 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for user 0e3f8c861a9c49119fc531e2a159ec9d and project 5bc75af3ba6c442889ce29351414e110. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:28:19.546679 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:19.547429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:19.548004 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:19.548823 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:19.549402 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:19.549935 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:19.555858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Going to run 1 instances... {{(pid=121558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:28:19.558316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:28:19.698760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:19.706523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-77b37e46-96e3-44f9-bf07-e2fb654cb492 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1499 microversion: 2.1 time: 0.171809 Aug 29 21:28:19.707286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 101/211] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:19 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:19.731773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:19.731773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:19.738927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:19.739612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:19.740082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:19.740788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:19.741240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:19.741661 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:19.790902 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-38981562-e7f1-46b7-9fc6-d843ccf409f8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.832175 Aug 29 21:28:19.792308 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 111/212] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Aug 29 21:28:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 21:28:19.802796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-827a7753-b3f0-4506-9929-cf54a74ffe50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:19.803400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-827a7753-b3f0-4506-9929-cf54a74ffe50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:19.887124 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-827a7753-b3f0-4506-9929-cf54a74ffe50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:19.892140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-827a7753-b3f0-4506-9929-cf54a74ffe50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:19.894868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-827a7753-b3f0-4506-9929-cf54a74ffe50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:19.896218 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-827a7753-b3f0-4506-9929-cf54a74ffe50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1282 microversion: 2.20 time: 0.097255 Aug 29 21:28:19.900910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 112/213] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:19 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:28:19.955360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:19.965037 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f21567e1-fcdd-4f20-b650-c67b7b050ae9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1513 microversion: 2.1 time: 0.239726 Aug 29 21:28:19.979922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 102/214] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:19 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:20.918884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a65e7c10-c7a9-4767-97dc-863d8ef50abe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:20.919682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a65e7c10-c7a9-4767-97dc-863d8ef50abe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:20.976568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a65e7c10-c7a9-4767-97dc-863d8ef50abe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:20.987579 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a65e7c10-c7a9-4767-97dc-863d8ef50abe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:20.989584 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a65e7c10-c7a9-4767-97dc-863d8ef50abe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:20.990697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a65e7c10-c7a9-4767-97dc-863d8ef50abe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1282 microversion: 2.20 time: 0.075809 Aug 29 21:28:20.991689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 113/215] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:20 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:22.015596 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:22.016353 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:22.023069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:22.023810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:22.024266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:22.026324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:22.026324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:22.026324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:22.107017 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:22.114589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:22.116124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:22.117176 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c1861091-9255-42b5-8b22-9bc979c1852d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1286 microversion: 2.20 time: 0.105963 Aug 29 21:28:22.118057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 103/216] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:22 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:22.263576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:22.266501 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:22.273989 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:22.281310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:22.281310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:22.281310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:22.281310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:22.282047 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:22.307117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'flavor' on Instance uuid 28b9b318-ba34-455a-90b9-4ff5619fa02e {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:28:22.760146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-35664090-dca4-43c6-ab44-66e575d9773c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e/action" status: 200 len: 32 microversion: 2.1 time: 0.500704 Aug 29 21:28:22.760742 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 114/217] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:28:22 2022] POST /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e/action => generated 32 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:28:22.771163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:22.771762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:22.778249 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:22.778725 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:22.779154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:22.779846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:22.780358 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:22.780821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:22.937129 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:22.947830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ad92bdab-66e2-44b3-ad2c-2397fcdadea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.180392 Aug 29 21:28:22.948442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 104/218] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:22 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:23.146373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:23.147086 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:23.154689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:23.155310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:23.155974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:23.156754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:23.157608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:23.158275 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:23.241055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:23.275596 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:23.276866 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:23.280149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-54f356b3-af5c-4de8-a09b-57efdf2e7a20 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1334 microversion: 2.20 time: 0.138602 Aug 29 21:28:23.280747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 115/219] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:23 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:23.974006 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:23.975662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:23.987642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:23.988315 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:23.989546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:23.990565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:23.991219 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:23.994208 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:24.217572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:24.229057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c342a3d1-fa38-4166-9338-ce6507fb261b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.260154 Aug 29 21:28:24.230128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 105/220] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:23 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:24.303917 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:24.304549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:24.313303 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:24.313800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:24.314224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:24.314926 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:24.315397 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:24.315812 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:24.411683 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:24.421156 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:24.423006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:24.424316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9f98a851-4744-487b-b22f-4efc509103e5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1340 microversion: 2.20 time: 0.124637 Aug 29 21:28:24.427199 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 116/221] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:24 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1340 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:28:25.252535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:25.253289 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:25.259965 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:25.260450 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:25.261215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:25.262060 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:25.262484 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:25.262797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:25.408261 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:25.417412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b808ca11-18f8-4df4-91ef-17f19f2f1035 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.169304 Aug 29 21:28:25.434222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 106/222] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:25 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:25.456566 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:25.457948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:25.465072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:25.465745 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:25.466328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:25.467192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:25.468518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:25.469094 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:25.634748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:25.644233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:25.645709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:25.646819 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5600fa69-1f5e-47aa-b855-14748cde549d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.194979 Aug 29 21:28:25.647380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 117/223] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:25 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:25.729657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-78fcbbc4-1666-4502-bdb5-18b21590ea18 req-422adf65-9b99-4597-b235-7a94c5820c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce9c011-918f-4702-83d6-cd5fd83a1a3a", "tag": "7d00a0ed-45ea-43c9-98bc-7122049be3a0"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:25.739276 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-78fcbbc4-1666-4502-bdb5-18b21590ea18 req-422adf65-9b99-4597-b235-7a94c5820c03 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:25.740290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-78fcbbc4-1666-4502-bdb5-18b21590ea18 req-422adf65-9b99-4597-b235-7a94c5820c03 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:25.740290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-78fcbbc4-1666-4502-bdb5-18b21590ea18 req-422adf65-9b99-4597-b235-7a94c5820c03 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:25.752035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-78fcbbc4-1666-4502-bdb5-18b21590ea18 req-422adf65-9b99-4597-b235-7a94c5820c03 service nova] Creating event network-changed:7d00a0ed-45ea-43c9-98bc-7122049be3a0 for instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a on hv-cinder-85426 Aug 29 21:28:25.757787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-78fcbbc4-1666-4502-bdb5-18b21590ea18 req-422adf65-9b99-4597-b235-7a94c5820c03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031956 Aug 29 21:28:25.758571 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 107/224] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:26.438912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:26.439947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:26.445894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:26.446369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:26.446794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:26.447476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:26.447936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:26.448355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:26.581956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:26.591742 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7d91483c-9b9b-43f5-866b-aadf39952dcd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.156567 Aug 29 21:28:26.594542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 118/225] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:26 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:26.669585 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:26.670287 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:26.677114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:26.679744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:26.679744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:26.679744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:26.679744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:26.680165 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:26.822116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:26.835815 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:26.837286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:26.838661 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b726bd27-acd8-47c7-a3ba-dbce4b6c6bc4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.173898 Aug 29 21:28:26.839216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 108/226] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:26 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:27.615922 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:27.617443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:27.624562 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:27.625357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:27.625912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:27.626844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:27.627458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:27.628214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:27.767051 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:27.770619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:27.775140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3f549a0c-4e42-46a7-907c-ad2cac221c51 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.164416 Aug 29 21:28:27.775787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 119/227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:27 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:27.862879 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:27.863492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:27.870926 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:27.871680 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:27.872241 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:27.873015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:27.873468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:27.873881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:28.033130 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:28.042422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:28.044259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:28.046718 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3d27ea81-5ca7-4be2-82dd-3a7d11976442 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.187139 Aug 29 21:28:28.046718 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 109/228] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:27 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:28.797315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:28.800884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:28.815683 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:28.816765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:28.816765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:28.817337 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:28.817824 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:28.818331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:28.999688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:29.009068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-eda4f021-971b-4514-bcfa-b6e316b714c0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.216408 Aug 29 21:28:29.010394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 120/229] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:28 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:29.070797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:29.071436 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:29.078285 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:29.078777 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:29.079209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:29.080197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:29.080575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:29.081083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:29.236310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:29.246049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:29.247660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:29.249099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9cf067b8-76fe-4cef-b1a1-76ca20e44e8f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.182254 Aug 29 21:28:29.250339 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 110/230] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:29 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:30.046824 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:30.052865 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:30.053477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:30.059805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:30.060336 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:30.060764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:30.062604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:30.063199 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:30.063915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:30.278324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:30.283093 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:30.303680 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:30.304842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:30.306835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:30.306835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:30.308022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:30.309054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:30.310112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:30.325634 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c02b4aeb-8aeb-4c6f-ac16-d8119bbd6d24 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.280202 Aug 29 21:28:30.327816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 121/231] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:30 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:30.575615 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:30.584033 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:30.585472 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:30.586668 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6348f0ab-bafe-447b-b00b-b220358c3679 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.316324 Aug 29 21:28:30.600256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 111/232] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:30 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:31.355941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:31.356668 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:31.358595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=14 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:31.364516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:31.364929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:31.365363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:31.366059 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:31.366510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:31.366933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:31.499722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:31.507779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-74127acb-a198-4c65-8c23-3a9d32fd16d5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.156271 Aug 29 21:28:31.508640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 122/233] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:31 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:31.612636 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:31.613238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:31.625903 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:31.631812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:31.631812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:31.631812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:31.631812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:31.632195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:31.792270 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:31.801056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:31.802789 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:31.803962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-89808834-43a3-4544-b3ff-6be70ec10f44 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.195389 Aug 29 21:28:31.804525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 112/234] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:31 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:32.530761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:32.531996 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:32.538362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:32.538855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:32.539301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:32.540034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:32.540487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:32.541377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:32.698292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:32.709216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-64c2719a-5e02-4f2f-9a3e-4e6d7af8779f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.183393 Aug 29 21:28:32.709798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 123/235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:32 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:32.827845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:32.839351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:32.858890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:32.859515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:32.860239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:32.861219 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:32.861900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:32.885173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:33.047920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:33.069172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:33.072803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:33.074354 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-503f2754-e2c1-437d-8438-143e0b70e04e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.252330 Aug 29 21:28:33.075862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 113/236] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:32 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:33.737513 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:33.738079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:33.750517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:33.751065 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:33.751508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:33.752628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:33.752736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:33.753131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:33.959582 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:33.969173 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fb382e2b-aadf-48c7-acd1-92a70fd2db1f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.235847 Aug 29 21:28:33.972552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 124/237] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:33 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:34.108209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:34.110428 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:34.118005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:34.119228 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:34.120234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:34.121272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:34.121929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:34.122691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:34.349186 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:34.361221 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:34.362927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:34.364079 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ddad661d-18ef-4dc7-8668-8b078ee1f61a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.263589 Aug 29 21:28:34.364638 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 114/238] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:34 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:34.438838 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-7eeb1c14-4f1d-4a44-91f3-225cededfa34 req-eceec09e-7880-4ac4-92d7-332756b314fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9c011-918f-4702-83d6-cd5fd83a1a3a", "name": "network-vif-plugged", "status": "completed", "tag": "7d00a0ed-45ea-43c9-98bc-7122049be3a0"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:34.449578 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-7eeb1c14-4f1d-4a44-91f3-225cededfa34 req-eceec09e-7880-4ac4-92d7-332756b314fb service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:34.456610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-7eeb1c14-4f1d-4a44-91f3-225cededfa34 req-eceec09e-7880-4ac4-92d7-332756b314fb service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:34.457622 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-7eeb1c14-4f1d-4a44-91f3-225cededfa34 req-eceec09e-7880-4ac4-92d7-332756b314fb service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:34.470228 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-7eeb1c14-4f1d-4a44-91f3-225cededfa34 req-eceec09e-7880-4ac4-92d7-332756b314fb service nova] Creating event network-vif-plugged:7d00a0ed-45ea-43c9-98bc-7122049be3a0 for instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a on hv-cinder-85426 Aug 29 21:28:34.476708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-7eeb1c14-4f1d-4a44-91f3-225cededfa34 req-eceec09e-7880-4ac4-92d7-332756b314fb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041265 Aug 29 21:28:34.477600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 125/239] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:28:34.990635 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:34.991639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:35.001605 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:35.002492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:35.003197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:35.004467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:35.005203 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:35.005984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:35.259942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:35.280424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-277e2fa0-0d81-4447-b59b-5184a72574dc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.294001 Aug 29 21:28:35.281172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 115/240] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:34 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:35.394189 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:35.394189 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:35.398047 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:35.398791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:35.399320 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:35.400156 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:35.400602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:35.401042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:35.800538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:35.809355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:35.817153 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:35.818346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3092b126-d6ac-4f41-ac83-50d60c948de2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.435507 Aug 29 21:28:35.819109 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 126/241] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:35 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:36.302333 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:36.304474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:36.317855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:36.318360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:36.318799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:36.319515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:36.319995 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:36.320593 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:36.852215 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:36.852843 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:36.866102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:36.868078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:36.868816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:36.870001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:36.872229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:36.874612 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:36.910939 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:36.919774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5e8757fb-8d60-4230-8e32-dfccb3615b66 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.621957 Aug 29 21:28:36.939299 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 116/242] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:36 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:37.571816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:37.582041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:37.583666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:37.585031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4d8f03d4-26b7-475b-b012-1e3aadc1a0c0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.740239 Aug 29 21:28:37.585642 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 127/243] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:36 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:28:37.948920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:37.949539 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:37.952867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=46 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:37.958196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:37.958991 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:37.959625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:37.960565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:37.961422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:37.961891 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:38.449359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:38.451951 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:38.461986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-fd592b0c-d4e7-454b-89b5-66c1f310f07d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1499 microversion: 2.1 time: 0.519056 Aug 29 21:28:38.492813 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 117/244] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:37 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1499 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:38.503095 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0468b24b-bdb5-416a-8fda-8dcb133a0597"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:38.505469 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:38.513489 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:38.514300 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:38.514900 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:38.516070 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:38.516894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:38.517545 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:38.543248 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] HTTP exception thrown: Cannot 'attach_volume' instance 28b9b318-ba34-455a-90b9-4ff5619fa02e while it is in vm_state rescued Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Request method failure captured: Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: POST /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e/os-volume_attachments HTTP/1.1 Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 74 Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VAKorWYiJaDKSSEZ11WWrQkfPVT8wxHn8T26g1yqqzyhW2JAhbu3_S1nxRmQ70ZuZqG6_BrQzX1ADV05SpV9EossnjrkiMPSBPoBmlFlWw93_0pmdc0oyC_0MObKokOavxNqNayYYo0Dos-E2Ev9T2uk4K-q6UuZQm-wM7864QaQ Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:28:38.545286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd7bb76694c2499895f24e611c644a27", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: b7e0a78238e94fa4a8209550c901a9a5 Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {"volumeAttachment": {"volumeId": "0468b24b-bdb5-416a-8fda-8dcb133a0597"}} Aug 29 21:28:38.547213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Cannot 'attach_volume' instance 28b9b318-ba34-455a-90b9-4ff5619fa02e while it is in vm_state rescued Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'server_id': '28b9b318-ba34-455a-90b9-4ff5619fa02e', 'body': {'volumeAttachment': {'volumeId': '0468b24b-bdb5-416a-8fda-8dcb133a0597'}}} Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28b9b318-ba34-455a-90b9-4ff5619fa02e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:28:38.548130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 28b9b318-ba34-455a-90b9-4ff5619fa02e while it is in vm_state rescued Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:28:38.549326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:28:38.550413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:28:38.550413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:28:38.550413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 28b9b318-ba34-455a-90b9-4ff5619fa02e while it is in vm_state rescued Aug 29 21:28:38.550413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:28:38.552058 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Returning 409 to user: Cannot 'attach_volume' instance 28b9b318-ba34-455a-90b9-4ff5619fa02e while it is in vm_state rescued {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:28:38.555142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5bb7efe0-82f1-4909-8e12-ee2f30c8df48 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059592 Aug 29 21:28:38.559640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 128/245] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:28:38 2022] POST /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:28:38.565744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:38.566278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:38.575988 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:38.578476 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:38.578914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:38.579641 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:38.580124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:38.580537 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:38.613603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:38.614970 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:38.630436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:38.634046 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:38.635650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:38.638873 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:38.640229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:38.643598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:38.860178 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:38.861563 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:38.864582 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:38.866400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-66f1213e-38fa-48b1-b06e-175db5dda5c4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1408 microversion: 2.20 time: 0.259671 Aug 29 21:28:38.867624 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 129/246] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:38 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:39.152068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0af5b97f-b21d-4fd5-82e3-c35f9dd3bfb3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e/action" status: 202 len: 0 microversion: 2.1 time: 0.589353 Aug 29 21:28:39.158632 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 118/247] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:28:38 2022] POST /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:28:39.166642 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:39.167681 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:39.175201 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:39.176258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:39.177312 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:39.178382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:39.178939 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:39.179644 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:39.368006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:39.377106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-66c37890-39af-43fd-8521-eb3e49caaa2d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1507 microversion: 2.1 time: 0.215181 Aug 29 21:28:39.377549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 130/248] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:39 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:39.889585 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:39.890298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:39.896959 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:39.905548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:39.905548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:39.905548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:39.905548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:39.906030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:40.364777 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:40.385258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:40.385258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:40.386075 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0522f3c6-d3d8-4773-816a-200a5f7cf96c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1600 microversion: 2.20 time: 0.497541 Aug 29 21:28:40.387015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 119/249] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:28:39 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1600 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:40.401020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:40.401814 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:40.409174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:40.409666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:40.410160 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:40.415801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:40.417044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:40.417857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:40.418583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:40.419259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:40.432746 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:40.440130 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:40.440946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:40.441994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:40.442456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:40.447420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:40.615382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:40.623441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6172c11f-8574-49a7-9956-02159d15d33c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1507 microversion: 2.1 time: 0.226262 Aug 29 21:28:40.624379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 131/250] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:40 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:40.651350 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7ee15962-422e-485d-ac36-f12ce39aa69d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.239652 Aug 29 21:28:40.652276 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 120/251] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Aug 29 21:28:40 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:28:41.644811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:41.645568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:41.666626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:41.667483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:41.668098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:41.668973 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:41.669567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:41.671255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:41.979118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:41.987226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9080aef3-f145-431e-adf1-1addd07f05c7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1507 microversion: 2.1 time: 0.346299 Aug 29 21:28:41.987910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 132/252] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:41 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:42.234410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-aed198ff-e1da-4d61-afab-f5190be19b88 req-2d252be9-04df-444a-89f2-e48c316ca0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce9c011-918f-4702-83d6-cd5fd83a1a3a", "tag": "7d00a0ed-45ea-43c9-98bc-7122049be3a0"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:42.272252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-aed198ff-e1da-4d61-afab-f5190be19b88 req-2d252be9-04df-444a-89f2-e48c316ca0f5 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:42.272993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-aed198ff-e1da-4d61-afab-f5190be19b88 req-2d252be9-04df-444a-89f2-e48c316ca0f5 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:42.273687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-aed198ff-e1da-4d61-afab-f5190be19b88 req-2d252be9-04df-444a-89f2-e48c316ca0f5 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:42.321219 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-aed198ff-e1da-4d61-afab-f5190be19b88 req-2d252be9-04df-444a-89f2-e48c316ca0f5 service nova] Creating event network-changed:7d00a0ed-45ea-43c9-98bc-7122049be3a0 for instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a on hv-cinder-85426 Aug 29 21:28:42.338684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-aed198ff-e1da-4d61-afab-f5190be19b88 req-2d252be9-04df-444a-89f2-e48c316ca0f5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098114 Aug 29 21:28:42.339368 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 121/253] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:43.009730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:43.010556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:43.016862 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:43.017347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:43.017782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:43.019111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:43.019668 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:43.020043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:43.192795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:43.202174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-32c6dda0-a980-4b68-b03c-49f39da0afa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1507 microversion: 2.1 time: 0.195816 Aug 29 21:28:43.203556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 133/254] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:43 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:43.230746 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:43.231929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:43.243609 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:43.245562 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:43.246513 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:43.248037 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:43.249884 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:43.250718 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:43.283500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-297e753f-8e7f-4909-8b06-c8558d688b5a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/ips" status: 200 len: 151 microversion: 2.1 time: 0.059569 Aug 29 21:28:43.290515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 122/255] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:28:43 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/ips => generated 151 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:44.252675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:44.252675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:44.252675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:44.252675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:44.253319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:44.253319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:44.253319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:44.253319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:44.655252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:44.668505 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bcd65e32-56df-4cb7-9db2-ac3cd3f7ad43 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1513 microversion: 2.1 time: 0.442070 Aug 29 21:28:44.673314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 134/256] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:44 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:45.925598 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d121139-dcde-49d3-bb97-6dca1ca0ff59"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:45.942186 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:45.971577 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:45.972100 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:45.972865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:45.979146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:45.991984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:45.991984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:46.314544 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:46.315048 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:46.323263 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:46.323806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:46.324504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:46.325251 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:46.325722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:46.326205 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:46.360903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3c224132-9c0e-45c7-acc8-72a27860d428 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/ips" status: 200 len: 145 microversion: 2.1 time: 0.054612 Aug 29 21:28:46.372371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 135/257] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:28:46 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:47.065740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-232930b4-d967-4f68-94da-b56a17e449f7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'create', calling method: .version_select at 0x7fc8404705e0>, body: {"keypair": {"name": "tempest-keypair-604940027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyelm3wr4jXPMrrxbrFzfEN7M5RHQBJ8U2pRVs0r3TwCMoY0pn+9x/ysL3mLNsd2ajNDBrRuCM23I0pmkMktOe4uUg1IiyQerpRO9FLLROmPA3KtbLAf8+CUW2mYI3u4g=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:47.082697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-232930b4-d967-4f68-94da-b56a17e449f7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for project bd7bb76694c2499895f24e611c644a27. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:28:47.087070 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-232930b4-d967-4f68-94da-b56a17e449f7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for user b7e0a78238e94fa4a8209550c901a9a5 and project bd7bb76694c2499895f24e611c644a27. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:28:47.397952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-232930b4-d967-4f68-94da-b56a17e449f7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.336395 Aug 29 21:28:47.402026 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 136/258] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:28:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 21:28:47.624058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-21b63539-a790-45f9-960e-773a37253f82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.708761 Aug 29 21:28:47.631243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 123/259] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:28:45 2022] POST /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments => generated 194 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:51.530687 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f1eb04a-93b1-4ea7-8327-b5616b78f70e"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:51.534002 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:51.541405 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:51.542169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:51.542781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:51.543703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:51.544423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:51.545061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:51.958746 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-473207420", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f98a05d-9a6f-4b38-8a53-5d74a6efa394"}], "security_groups": [{"name": "tempest-securitygroup--837110870"}], "key_name": "tempest-keypair-604940027", "user_data": "}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:52.127174 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] validate_networks() for [('8f98a05d-9a6f-4b38-8a53-5d74a6efa394', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:28:52.601877 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:28:52.602302 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:28:52.602932 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:28:52.603184 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:28:52.603763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:28:52.619563 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:52.620207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:52.620913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:52.622514 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:52.623855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:52.624550 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:52.645380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for project bd7bb76694c2499895f24e611c644a27. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:28:52.649812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Getting quotas for user b7e0a78238e94fa4a8209550c901a9a5 and project bd7bb76694c2499895f24e611c644a27. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:28:52.663651 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:28:52.666273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:28:52.723820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:52.875924 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-63c41308-7fca-4f9c-a6fc-d7456d2ccd62 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.922325 Aug 29 21:28:52.876586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 124/260] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:28:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:28:52.901652 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-86e0437a-2e3f-4119-b9f0-29b6414a2f7a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:52.901652 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-86e0437a-2e3f-4119-b9f0-29b6414a2f7a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:52.979267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-86e0437a-2e3f-4119-b9f0-29b6414a2f7a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:52.991390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-86e0437a-2e3f-4119-b9f0-29b6414a2f7a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1244 microversion: 2.1 time: 0.106903 Aug 29 21:28:52.992874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 125/261] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:52 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:53.069178 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2aac9a15-abff-4bc0-8631-06fbfa4eab57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.543713 Aug 29 21:28:53.069794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 137/262] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:28:51 2022] POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-volume_attachments => generated 194 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:54.024146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2ddd0a2b-148d-4e7c-a046-0208bcb4c51e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:54.025493 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2ddd0a2b-148d-4e7c-a046-0208bcb4c51e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:54.086002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2ddd0a2b-148d-4e7c-a046-0208bcb4c51e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:54.096964 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2ddd0a2b-148d-4e7c-a046-0208bcb4c51e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1244 microversion: 2.1 time: 0.074923 Aug 29 21:28:54.098721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 126/263] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:54 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:55.129057 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:55.129893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:55.137260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:55.146285 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:55.147177 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:55.147777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:55.148669 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:55.153940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:55.153940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:55.257727 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:55.288908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3d0c561b-f217-4db5-a362-efbf59aea301 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1248 microversion: 2.1 time: 0.172401 Aug 29 21:28:55.290104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 138/264] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:55 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1248 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:56.311532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:56.312279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:56.322913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:56.324322 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:56.325640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:56.327586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:56.328200 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:56.330199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:56.399459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:56.411239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-77ceed18-95c1-457d-a8aa-fbf46d6f75b0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1248 microversion: 2.1 time: 0.104109 Aug 29 21:28:56.411841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 127/265] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:56 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1248 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:57.437328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:57.443522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:57.443522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=4 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:57.454595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:57.455323 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:57.455774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:57.456510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:57.456961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:57.457384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:57.535127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:57.543427 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f414f62e-f29d-4784-b3c1-7244dd5d03ea tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1240 microversion: 2.1 time: 0.111311 Aug 29 21:28:57.544184 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 139/266] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:57 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:58.571528 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:58.578007 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:58.580838 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:58.581719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:58.582529 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:58.583700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:58.584379 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:58.584972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:58.668410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:58.682359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-efe4d550-14e5-47a6-8024-d6b9b9608ebc tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1296 microversion: 2.1 time: 0.118901 Aug 29 21:28:58.683977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 128/267] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:58 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:59.708794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:59.709698 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:28:59.717482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:59.717961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:59.718393 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:59.719084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:28:59.719532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:28:59.719977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:28:59.792036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:28:59.801120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4a9df7f8-525e-4197-bace-dce5e6698dc3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1304 microversion: 2.1 time: 0.096288 Aug 29 21:28:59.802764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 140/268] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:28:59 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:00.042739 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-19ecf8d4-1d59-4de7-943a-b09fb3b9cbf6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: .version_select at 0x7fc8403a2940>, body: {"keypair": {"name": "tempest-keypair-1070809274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxMDfoKERTC2cWiARcVHcKTB/tHtMcBsXb5/jv7I+HqHLV7vuU+7psvWIWqpe8dld1YdPUlc6daTILNbiQYCrBtrQaHEqF3mUgTw/MokPM54KAC0NVk1giQRg843fKRg=="}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:00.073485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-19ecf8d4-1d59-4de7-943a-b09fb3b9cbf6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:29:00.078588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-19ecf8d4-1d59-4de7-943a-b09fb3b9cbf6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:29:00.296245 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-19ecf8d4-1d59-4de7-943a-b09fb3b9cbf6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277366 Aug 29 21:29:00.297559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 129/269] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:29:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:00.829886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:00.829886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:00.846203 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:00.846974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:00.847579 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:00.848749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:00.849625 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:00.850257 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:01.031711 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:01.050568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-89181c9e-b791-4375-a37a-18c6ffd3f76d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.228987 Aug 29 21:29:01.066888 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 141/270] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:00 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:02.075053 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:02.078625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:02.083122 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:02.084062 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:02.084741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:02.085702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:02.086385 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:02.087051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:02.484895 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:02.494690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-09d3c698-05c8-4b9b-94a9-4ac6cf426620 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.423899 Aug 29 21:29:02.508972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 130/271] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:02 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:03.520567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:03.521225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:03.528437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:03.528954 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:03.529577 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:03.530129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:03.530583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:03.531040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:03.673585 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:03.681929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a6531a8f-5eaa-4af1-8585-3efbcda480df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.165193 Aug 29 21:29:03.682615 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 142/272] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:03 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:04.494696 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-672140dc-cd5d-49fe-8976-9f922418ddca req-c3a68b43-0157-4ebf-9774-08ea7ded9728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47361729-1df7-4084-8819-76e4b8e43a1e", "tag": "81cd5932-3a95-43b6-86ae-902a62b744b9"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:04.500461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.506789 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-672140dc-cd5d-49fe-8976-9f922418ddca req-c3a68b43-0157-4ebf-9774-08ea7ded9728 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:04.507595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-672140dc-cd5d-49fe-8976-9f922418ddca req-c3a68b43-0157-4ebf-9774-08ea7ded9728 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:04.508291 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-672140dc-cd5d-49fe-8976-9f922418ddca req-c3a68b43-0157-4ebf-9774-08ea7ded9728 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:04.525089 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-672140dc-cd5d-49fe-8976-9f922418ddca req-c3a68b43-0157-4ebf-9774-08ea7ded9728 service nova] Creating event network-changed:81cd5932-3a95-43b6-86ae-902a62b744b9 for instance 47361729-1df7-4084-8819-76e4b8e43a1e on hv-cinder-85426 Aug 29 21:29:04.534836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-672140dc-cd5d-49fe-8976-9f922418ddca req-c3a68b43-0157-4ebf-9774-08ea7ded9728 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043596 Aug 29 21:29:04.537128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 131/273] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:04.647175 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1376555014", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d52e082-ed9a-4937-bc0b-8b03e2527c03"}], "security_groups": [{"name": "tempest-securitygroup--651321985"}], "key_name": "tempest-keypair-1070809274", "user_data": "}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:04.713981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:04.715245 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:04.728176 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:04.729413 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:04.730118 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:04.731592 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:04.732840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:04.733822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:04.806950 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.network.neutron [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] validate_networks() for [('5d52e082-ed9a-4937-bc0b-8b03e2527c03', None, None, None, None, None)] {{(pid=121558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:29:05.084417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:05.087266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6fece999-7e89-4433-a4eb-70fe27f4ea33 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.385756 Aug 29 21:29:05.088647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 132/274] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:04 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:05.292740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:29:05.293488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:29:05.294000 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:29:05.294403 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:29:05.295547 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:29:05.304828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:05.305309 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:05.305744 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:05.306480 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:05.306983 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:05.307357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:05.326096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:29:05.333313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:29:05.353721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Going to run 1 instances... {{(pid=121558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:29:05.356477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:29:05.411482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7d4899f1-01ce-4612-ae05-5b2750c4db05 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Action: 'create', calling method: .version_select at 0x7fc840626670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1941309463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUwC4QaxDwxgX4kq7agLBlgHMvvK/Z1u+Cqn/Vo5CDdeC+5xsKYbzIgQQ1hKXIyEYJhmGlNc8s5+QgrugYMmbyG2wDymMbUpSyWOyp5GZQExdAr7QyYozaW/Skz41lAhg=="}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:05.437634 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-7d4899f1-01ce-4612-ae05-5b2750c4db05 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Getting quotas for project 52ac0b73cab4494ab39d80f06c54e9da. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:29:05.442335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-7d4899f1-01ce-4612-ae05-5b2750c4db05 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Getting quotas for user 2e02c6c1c3bc49e8a63f0533c3ea5391 and project 52ac0b73cab4494ab39d80f06c54e9da. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:29:05.550216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-275d180a-ae03-4a20-aeb3-1e0c72a5af82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.914445 Aug 29 21:29:05.551719 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 143/275] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:29:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:29:05.567610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3d3f368c-2f46-4d40-9120-41f164fbaad8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:05.568536 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3d3f368c-2f46-4d40-9120-41f164fbaad8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:05.568883 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7d4899f1-01ce-4612-ae05-5b2750c4db05 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.162796 Aug 29 21:29:05.569722 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 133/276] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:29:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:29:05.641128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3d3f368c-2f46-4d40-9120-41f164fbaad8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:05.649046 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3d3f368c-2f46-4d40-9120-41f164fbaad8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1242 microversion: 2.1 time: 0.090175 Aug 29 21:29:05.649715 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-982665005", "imageRef": "25e29992-db52-4914-8a46-e315eb718cab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1941309463", "networks": [{"uuid": "292f73ed-e808-4244-8a17-4a958ad6e9d1"}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:05.650773 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 144/277] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:05 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:05.745226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] validate_networks() for [('292f73ed-e808-4244-8a17-4a958ad6e9d1', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:29:06.111459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:06.112136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:06.119016 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:06.119487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:06.119945 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:06.120651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:06.125138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:06.125138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:06.231429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:29:06.231845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:29:06.236820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:29:06.236820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:29:06.236820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:29:06.244411 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:06.244523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:06.245433 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:06.246626 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:06.247128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:06.248989 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:06.267558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Getting quotas for project 52ac0b73cab4494ab39d80f06c54e9da. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:29:06.271951 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Getting quotas for user 2e02c6c1c3bc49e8a63f0533c3ea5391 and project 52ac0b73cab4494ab39d80f06c54e9da. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:29:06.288001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:06.289895 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:29:06.294173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='25e29992-db52-4914-8a46-e315eb718cab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:29:06.300388 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-80dbaa7c-e1ed-4435-bef4-f64d653dcfa6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.193737 Aug 29 21:29:06.312611 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 145/278] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:06 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:06.483728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-aaca8729-2f5f-4754-889a-0a0821b49829 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839652 Aug 29 21:29:06.484441 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 134/279] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:29:06.496024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fe04c689-a177-4a5a-a735-5eefffd22c59 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:06.496626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fe04c689-a177-4a5a-a735-5eefffd22c59 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:06.564488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fe04c689-a177-4a5a-a735-5eefffd22c59 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:06.584400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fe04c689-a177-4a5a-a735-5eefffd22c59 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1258 microversion: 2.1 time: 0.092316 Aug 29 21:29:06.585113 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 146/280] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:06 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:06.594527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a0d4f751-7fc8-4554-a07a-820f5a41a345 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:06.603068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0d4f751-7fc8-4554-a07a-820f5a41a345 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:06.603570 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0d4f751-7fc8-4554-a07a-820f5a41a345 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:06.604161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0d4f751-7fc8-4554-a07a-820f5a41a345 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:06.668977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a0d4f751-7fc8-4554-a07a-820f5a41a345 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Going to try to stop instance {{(pid=121559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:29:06.688108 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2bf0174f-8f36-4e61-84a1-d25460ca7b40 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:06.690822 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2bf0174f-8f36-4e61-84a1-d25460ca7b40 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:06.750967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2bf0174f-8f36-4e61-84a1-d25460ca7b40 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:06.758741 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2bf0174f-8f36-4e61-84a1-d25460ca7b40 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1242 microversion: 2.1 time: 0.076974 Aug 29 21:29:06.759185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 147/281] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:06 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:06.902086 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a0d4f751-7fc8-4554-a07a-820f5a41a345 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action" status: 202 len: 0 microversion: 2.1 time: 0.311473 Aug 29 21:29:06.903202 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 135/282] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:29:06 2022] POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:29:06.914400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:06.914400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:06.919458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:06.920630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:06.921057 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:06.921767 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:06.922221 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:06.922648 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:07.063540 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:07.072627 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3ea611da-2df5-45ca-ab1c-494e98560f5e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.164693 Aug 29 21:29:07.073220 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 148/283] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:06 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:07.330954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:07.332245 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:07.341056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:07.343210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:07.343868 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:07.344739 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:07.345328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:07.345874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:07.483698 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:07.491845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0dd09d05-0cc1-4448-b02f-cdeb20a86ef2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.169161 Aug 29 21:29:07.492622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 136/284] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:07 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:07.605740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-875edd05-15a9-4be0-b4a9-a1909b77f8aa tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:07.606549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-875edd05-15a9-4be0-b4a9-a1909b77f8aa tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:07.664420 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-875edd05-15a9-4be0-b4a9-a1909b77f8aa tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:07.675941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-875edd05-15a9-4be0-b4a9-a1909b77f8aa tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1258 microversion: 2.1 time: 0.073851 Aug 29 21:29:07.677042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 149/285] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:07 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:07.778490 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:07.779098 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:07.785628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:07.786106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:07.786656 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:07.787357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:07.787806 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:07.788255 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:07.854760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:07.863432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-cf7d4058-7483-4182-b7ff-8dde606c3e2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1246 microversion: 2.1 time: 0.088644 Aug 29 21:29:07.864042 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 137/286] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:07 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:08.094963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:08.095568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:08.104388 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.104791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.105225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.105915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.106364 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.106889 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.256616 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:08.265151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1641e81a-f9db-48e1-a8f9-a98fe6640f50 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.173991 Aug 29 21:29:08.265734 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 150/287] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:08 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:08.512420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:08.513057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:08.519699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.520208 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.520643 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.521336 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.521791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.522210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.538801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.662895 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:08.670902 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-64a938dc-1abe-41c0-bd1d-3bcf06e8ba64 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.162292 Aug 29 21:29:08.671483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 138/288] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:08 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:08.697476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:08.698089 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:08.704919 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.705405 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.705909 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.706667 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.707338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.707761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.779846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:08.789071 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4ee64b4f-ba58-4ef2-870c-bf0cd8cc3583 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1262 microversion: 2.1 time: 0.095397 Aug 29 21:29:08.790154 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 151/289] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:08 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:08.885214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:08.885846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:08.888190 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.893611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.894090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.894525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.895224 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:08.895669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:08.896112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:08.991086 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:09.000376 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b130b9a3-fd43-496f-b653-82825880bdc9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1246 microversion: 2.1 time: 0.118050 Aug 29 21:29:09.000752 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 139/290] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:08 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:09.286221 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:09.286764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:09.292792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:09.293273 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:09.293710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:09.294414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:09.294863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:09.295321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:09.431157 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:09.442299 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3ef6e8ce-0c33-403c-94f2-4c4302f003af tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.159992 Aug 29 21:29:09.448346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 152/291] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:09 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:09.692760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:09.693545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:09.700093 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:09.700395 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:09.700903 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:09.701736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:09.702030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:09.702454 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:09.811201 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:09.811818 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:09.831785 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:09.832576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:09.832947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:09.833783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:09.834103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:09.834517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:09.855012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:09.867957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6bdc0dff-7e62-4688-a923-39d116089666 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.179255 Aug 29 21:29:09.869028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 140/292] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:09 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:09.912956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:09.927185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-57208970-7394-4339-8c75-04a165ea6ffc tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1254 microversion: 2.1 time: 0.115196 Aug 29 21:29:09.927185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 153/293] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:09 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1254 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:10.021510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:10.022240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:10.031540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.032072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.032636 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:10.034862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.040076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.040750 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:10.115674 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:10.124730 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-fda93ca7-9430-42af-8c3c-4d250457e3c2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1238 microversion: 2.1 time: 0.106931 Aug 29 21:29:10.139099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 141/294] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:10 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:10.469068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:10.470159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:10.494560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.496990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.502547 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:10.503692 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.504419 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.504964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:10.769855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:10.777919 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5a1242ef-39a1-4a7a-b918-5e43da1bd413 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.314380 Aug 29 21:29:10.778497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 154/295] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:10 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:10.891719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:10.906349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:10.906349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.906349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.906349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:10.906888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.906888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.906888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:10.947137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:10.947788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:10.956518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.957007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.957443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:10.958209 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:10.958693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:10.959169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:11.049453 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:11.054588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:11.058723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8d70a62a-ea8a-4e0a-8d11-070e414339ed tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1310 microversion: 2.1 time: 0.115982 Aug 29 21:29:11.071146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 155/296] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:10 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1310 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:11.071380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-109a36b4-daf9-4ca2-9d15-7ca512f835d3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.180005 Aug 29 21:29:11.071380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 142/297] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:10 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:11.145652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:11.146455 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:11.152688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:11.153170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:11.153710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:11.154621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:11.155101 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:11.155511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:11.223866 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:11.231791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0500f0f2-fa03-4dfd-9e59-7b84327a7542 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1294 microversion: 2.1 time: 0.089978 Aug 29 21:29:11.233245 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 156/298] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:11 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:11.799751 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:11.800404 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:11.806670 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:11.807206 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:11.807635 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:11.808560 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:11.809037 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:11.809653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:12.027042 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:12.036857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-fd497555-1364-4bd1-a274-58772c206512 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.241110 Aug 29 21:29:12.037451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 143/299] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:11 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:12.085418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:12.086686 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:12.090460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:12.091022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:12.098623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:12.098623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:12.098623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:12.098623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:12.099068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:12.099068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:12.099917 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:12.100482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:12.101048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:12.102122 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:12.102691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:12.103424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:12.325579 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:12.336967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f544491d-8b3f-4a2f-b160-4a6a7cede1b7 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.252816 Aug 29 21:29:12.337556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 144/300] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:12 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:12.343229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:12.343852 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:12.352239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:12.352741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:12.353298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:12.354127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:12.354793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:12.355244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:12.392082 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:12.416223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9985b140-45cc-466c-bebf-677b7eafb5bf tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1318 microversion: 2.1 time: 0.322981 Aug 29 21:29:12.417307 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 157/301] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:12 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:12.487123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:12.495674 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d0af0b1e-dae9-4727-8fd8-2c0e27c7de2a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1312 microversion: 2.1 time: 0.156900 Aug 29 21:29:12.496300 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 145/302] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:12 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:13.063412 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:13.064136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:13.079237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.080846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.081382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:13.082331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.083099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.083577 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:13.358486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:13.359118 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:13.367161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.367653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.368179 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:13.368865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.369324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.369777 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:13.506192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:13.512116 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.522245 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f54a4a68-1b6c-4337-aeff-d495022544fb tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.466803 Aug 29 21:29:13.522827 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 158/303] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:13 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:13.540241 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:13.540869 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:13.548777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.549529 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.550554 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:13.573704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.577954 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.579780 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:13.746135 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:13.771462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-eec6c0f2-04f0-43a3-adab-30bc64d4cecd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.415261 Aug 29 21:29:13.780992 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 146/304] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:13 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:13.790432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:13.791047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:13.826711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.827238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.829689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:13.830577 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:13.831181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:13.831665 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:14.024506 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:14.035018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9f5cf82a-8022-4dbf-8eed-273b9578aaea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.510788 Aug 29 21:29:14.048702 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 159/305] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:13 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:14.552605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:14.555162 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:14.568440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:14.568868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:14.569979 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:14.571379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:14.572267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:14.573160 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:14.836819 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:14.863762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dc474995-479e-4c6f-8959-b5a8009382c7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 1.078551 Aug 29 21:29:14.864928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 147/306] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:13 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:14.895460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:14.907912 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:14.924371 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:14.936658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:14.939538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:14.940845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:14.941843 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:14.950851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:15.142810 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:15.181673 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-11feac69-f853-4aad-9409-1cd7f976f60a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.637808 Aug 29 21:29:15.192135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 160/307] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:14 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:15.204787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-f6e94c90-8e4a-43ff-9bfa-cc930adade9a req-5215a9c2-0598-4570-b65c-f92f955bc89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47361729-1df7-4084-8819-76e4b8e43a1e", "name": "network-vif-plugged", "status": "completed", "tag": "81cd5932-3a95-43b6-86ae-902a62b744b9"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:15.238872 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f6e94c90-8e4a-43ff-9bfa-cc930adade9a req-5215a9c2-0598-4570-b65c-f92f955bc89d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:15.242386 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f6e94c90-8e4a-43ff-9bfa-cc930adade9a req-5215a9c2-0598-4570-b65c-f92f955bc89d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:15.243249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f6e94c90-8e4a-43ff-9bfa-cc930adade9a req-5215a9c2-0598-4570-b65c-f92f955bc89d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:15.296372 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-f6e94c90-8e4a-43ff-9bfa-cc930adade9a req-5215a9c2-0598-4570-b65c-f92f955bc89d service nova] Creating event network-vif-plugged:81cd5932-3a95-43b6-86ae-902a62b744b9 for instance 47361729-1df7-4084-8819-76e4b8e43a1e on hv-cinder-85426 Aug 29 21:29:15.314740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-f6e94c90-8e4a-43ff-9bfa-cc930adade9a req-5215a9c2-0598-4570-b65c-f92f955bc89d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109411 Aug 29 21:29:15.314740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 161/308] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:15.314740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:15.314740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:15.319219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:15.323431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:15.323966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:15.324417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:15.325224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:15.325688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:15.326803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:15.371739 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:15.386093 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c3d1e87b-8942-450e-ac08-b402dcd63ca3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.498503 Aug 29 21:29:15.394697 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 148/309] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:14 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:15.771066 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:15.783769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1f53420e-daf6-4245-a8a5-7d456f1cead5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.477543 Aug 29 21:29:15.784776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 162/310] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:15 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:15.907153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:15.915259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:15.929748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:15.930541 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:15.931241 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:15.932318 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:15.933076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:15.933761 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.132951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-6fb85f57-143b-4e69-9e7c-96da4035de13 req-18b934ab-fe94-47b6-9d0f-8c9f366c996c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28cecc9-0a87-4560-a3de-51196dcc5ad6", "tag": "3b0e05e5-994d-4858-af60-4b00e1a3aedf"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:16.178270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-6fb85f57-143b-4e69-9e7c-96da4035de13 req-18b934ab-fe94-47b6-9d0f-8c9f366c996c service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.178820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-6fb85f57-143b-4e69-9e7c-96da4035de13 req-18b934ab-fe94-47b6-9d0f-8c9f366c996c service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.180020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-6fb85f57-143b-4e69-9e7c-96da4035de13 req-18b934ab-fe94-47b6-9d0f-8c9f366c996c service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.211480 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-6fb85f57-143b-4e69-9e7c-96da4035de13 req-18b934ab-fe94-47b6-9d0f-8c9f366c996c service nova] Creating event network-changed:3b0e05e5-994d-4858-af60-4b00e1a3aedf for instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 on hv-cinder-85426 Aug 29 21:29:16.225519 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-6fb85f57-143b-4e69-9e7c-96da4035de13 req-18b934ab-fe94-47b6-9d0f-8c9f366c996c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097052 Aug 29 21:29:16.228287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 163/311] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:29:16.248853 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-d6072b2c-02c5-447b-be6e-4f9ed18deef6 req-99c27ff0-9276-4f7b-8b17-d8632289992b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd8e900-c6d1-40db-a1e7-ee9c3e703dff", "tag": "f7b98ffd-df0e-4679-b056-8aebb5b15590"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:16.280384 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=24 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:16.289700 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-d6072b2c-02c5-447b-be6e-4f9ed18deef6 req-99c27ff0-9276-4f7b-8b17-d8632289992b service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.289700 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-d6072b2c-02c5-447b-be6e-4f9ed18deef6 req-99c27ff0-9276-4f7b-8b17-d8632289992b service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.293152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-d6072b2c-02c5-447b-be6e-4f9ed18deef6 req-99c27ff0-9276-4f7b-8b17-d8632289992b service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.312448 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-d6072b2c-02c5-447b-be6e-4f9ed18deef6 req-99c27ff0-9276-4f7b-8b17-d8632289992b service nova] Creating event network-changed:f7b98ffd-df0e-4679-b056-8aebb5b15590 for instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff on hv-cinder-85426 Aug 29 21:29:16.334486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-d6072b2c-02c5-447b-be6e-4f9ed18deef6 req-99c27ff0-9276-4f7b-8b17-d8632289992b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095776 Aug 29 21:29:16.335909 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 164/312] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:16.350008 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:16.353227 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:16.370059 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.370651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.372226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.376394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:16.386355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.386976 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.387475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.389875 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3b9db707-1685-44a4-b5ef-5fa0cc7f0837 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.494860 Aug 29 21:29:16.390571 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 149/313] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:15 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:16.448723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:16.448723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:16.448723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.448723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.449347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.449347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.451640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.452602 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.721240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:16.767994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:16.780194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-08c23261-03b4-4a02-899e-7fb6581fe9ce tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.362760 Aug 29 21:29:16.780785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 150/314] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:16 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:16.811244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:16.812371 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:16.819953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.825474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.825474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.825474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:16.825474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:16.826440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:16.839541 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:16.853102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ebd313df-542c-441d-ad17-1dff0272e27d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.511939 Aug 29 21:29:16.853102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 165/315] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:16 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:17.159281 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:17.177134 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2f24dd76-c0a8-472a-8663-eac2d05608fb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.367064 Aug 29 21:29:17.177134 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 151/316] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:16 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:17.428628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:17.428628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:17.442017 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:17.445223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:17.446808 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:17.448774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:17.453338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:17.453338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:17.663192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:17.669698 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=14 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:17.673359 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-513b856e-7c83-4080-b588-e786db3128e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.249594 Aug 29 21:29:17.674303 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 166/317] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:17 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:17.811429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:17.812442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:17.826608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:17.827530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:17.828400 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:17.830821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:17.832242 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:17.833526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:17.876767 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:17.878774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:17.887629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:17.888450 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:17.889107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:17.890027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:17.890660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:17.891453 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:18.107782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:18.119646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b056fbdf-eaa8-47b7-861e-13294e6c68cc tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.250180 Aug 29 21:29:18.122670 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 167/318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:17 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:18.138760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:18.160056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-921757d4-2c64-4ee3-9cd6-79a50a27a89e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.345991 Aug 29 21:29:18.160056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 152/319] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:17 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:18.218680 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:18.219395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:18.226782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:18.229687 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:18.231379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:18.236443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:18.236963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:18.237463 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:18.440195 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:18.448963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-72d66605-fb17-4c6d-8b80-8716fdcfba2a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.234943 Aug 29 21:29:18.451647 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 168/320] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:18 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:18.708622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:18.715257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:18.725003 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:18.730191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:18.731810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:18.734083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:18.734754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:18.735197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:18.945179 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:18.957587 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0b98642e-1cfe-43d0-be3e-d8b01a297b10 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.257238 Aug 29 21:29:18.958940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 153/321] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:18 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:19.144537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:19.145141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:19.154796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:19.160852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:19.160852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:19.160852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:19.160852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:19.161315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:19.174621 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:19.175429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:19.188033 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:19.191415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:19.191415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:19.191415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:19.191415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:19.191800 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:19.383644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:19.393796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:19.396032 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2a9cb036-957b-499a-a5c8-5c9964944939 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.221016 Aug 29 21:29:19.396854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 154/322] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:19 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:19.402670 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-22aae146-580b-42ed-b00a-68cb4fb268a1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.261870 Aug 29 21:29:19.403779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 169/323] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:19 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:19.479857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:19.490227 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:19.501723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:19.502218 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:19.502658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:19.503411 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:19.503820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:19.509787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:19.509787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:19.705593 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:19.708360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f229b010-d4a7-4534-9c3b-e08f2bb5e344 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.234851 Aug 29 21:29:19.709446 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 155/324] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:19 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:19.993958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:19.995247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:20.003369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.004113 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.004724 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.005692 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.006345 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.006977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.285478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:20.314689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3e01322e-d33b-4d6b-8e75-2fe2e821f3de tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.323468 Aug 29 21:29:20.316913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 170/325] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:19 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:20.422985 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:20.423879 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:20.441660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:20.441963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.442657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.442900 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:20.443591 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.444818 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.446729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.448236 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.456722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.461056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.462438 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.464136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.465016 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.465824 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.725611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:20.751239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ef8f24d4-36b0-48b7-b097-e6f9762eb4d6 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.332625 Aug 29 21:29:20.753840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 156/326] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:20 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:20.765857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:20.768781 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:20.788932 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.797338 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.799677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.799677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:20.799677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:20.800865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:20.869103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:20.895870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1407d1a6-a185-422f-964e-eb73b133f602 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.467726 Aug 29 21:29:20.896643 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 171/327] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:20 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:21.074055 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:21.089750 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7395dab1-e10e-452c-8f88-600de3d80901 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.335839 Aug 29 21:29:21.090438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 157/328] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:20 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:21.347703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:21.348394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:21.355845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:21.356365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:21.356805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:21.357771 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:21.358581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:21.359194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:21.550328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:21.560043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f5edf681-5467-4240-b740-9a3484e131e2 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.216597 Aug 29 21:29:21.564810 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 172/329] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:21 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:21.778383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:21.780096 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:21.787616 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:21.788131 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:21.788863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:21.789596 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:21.790043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:21.790466 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:21.919032 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:21.924127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:21.945770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:21.946550 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:21.947167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:21.947913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:21.948371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:21.948798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:21.962860 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:21.971595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-13f239b2-d3c1-4335-987f-88628424e8ad tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.197052 Aug 29 21:29:21.972816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 158/330] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:21 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:22.092952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:22.101416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-db5d29ce-35b2-4b5a-9387-016f07102e57 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.186194 Aug 29 21:29:22.101985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 173/331] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:21 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:22.111932 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:22.112924 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:22.118957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:22.119664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:22.120309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:22.121010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:22.121462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:22.121891 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:22.281292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:22.290467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-663985ea-99ac-4107-8ab6-1cd03c4b5a9e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.181923 Aug 29 21:29:22.291766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 159/332] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:22 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:22.582749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:22.583358 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:22.592488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:22.592488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:22.592488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:22.593075 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:22.593293 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:22.594650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:22.751622 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:22.759671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-dfc405da-cc9f-441d-9aa4-c08281555fb0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.181592 Aug 29 21:29:22.760291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 174/333] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:22 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:22.993833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:22.994449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:23.001369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.001852 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.002288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.002996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.003452 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.003877 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.122634 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:23.123483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:23.129814 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.130210 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.130631 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.131337 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.131782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.132460 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.157616 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:23.162054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-809b4b31-8dd3-4019-8f54-b18838d7b553 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.172032 Aug 29 21:29:23.163192 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 160/334] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:22 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:23.296697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:23.306216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fc0220de-7b03-42bb-b5dc-48e35ee2df4c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.187224 Aug 29 21:29:23.313046 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:23.313952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:23.320662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.320893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 175/335] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:23 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:23.321533 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.322133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.323016 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.323622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.324221 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.470753 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:23.479267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f84bada8-02ce-4948-ad8f-65da9f6c6e29 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.169659 Aug 29 21:29:23.479498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 161/336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:23 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:23.781050 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:23.781790 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:23.783717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.788440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.788918 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.789350 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.790040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:23.790497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:23.790915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:23.941504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:23.949288 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-96e1629a-ac05-448d-b098-c4305b64a4e1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.172209 Aug 29 21:29:23.949859 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 176/337] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:23 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:24.183392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:24.184034 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:24.190843 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.191336 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.191773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:24.192501 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.192959 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.193388 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:24.328639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:24.329254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:24.335807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.340965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.341140 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:24.341249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:24.341249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.341249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.341249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:24.345799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a4ae0505-2ad8-46dc-815e-d238acdc58bd tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.166176 Aug 29 21:29:24.346521 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 162/338] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:24 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:24.357937 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:24.473158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:24.481356 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f8f9d334-3c4c-483c-a2c9-85c8fac49b46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.157473 Aug 29 21:29:24.482434 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 177/339] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:24 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:24.499216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:24.499831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:24.505870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.506347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.506781 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:24.507469 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.507945 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.508372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:24.639526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:24.647310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0d3c65ba-d854-49ea-9d2b-f6bb8da80b96 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.152611 Aug 29 21:29:24.647900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 163/340] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:24 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:24.971382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:24.972002 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:24.979027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.979567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.980028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:24.980857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:24.981177 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:24.981596 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:25.125893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:25.133960 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9f83fcca-6db6-4e19-832b-fa21f7e68a3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.166423 Aug 29 21:29:25.134542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 178/341] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:24 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:25.367059 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:25.367660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:25.374291 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:25.374698 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:25.375132 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:25.375837 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:25.376319 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:25.377590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:25.503734 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:25.504371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:25.510516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:25.511006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:25.511442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:25.512172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:25.512630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:25.513580 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:25.519865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:25.532180 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7e5a6d84-f73c-454d-bbf2-ddf8effff264 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.168722 Aug 29 21:29:25.538284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 164/342] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:25 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:25.648886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:25.657348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a99f9bdc-332d-4c0d-8eac-42b1aa4e96b7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.157943 Aug 29 21:29:25.658755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 179/343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:25 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:25.667370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:25.668009 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:25.674293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:25.674776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:25.675204 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:25.675939 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:25.676390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:25.676805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:25.814732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:25.823020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-29ae18bf-30ff-4341-9cb3-6404497b9f39 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.159445 Aug 29 21:29:25.823599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 165/344] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:25 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:26.154697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:26.162185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:26.162185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.162185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.162185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.162874 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.163317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.163748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.358406 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:26.366624 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2fcde434-091c-48a9-9d75-d918c188d93b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.215852 Aug 29 21:29:26.367197 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 180/345] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:26 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:26.555488 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:26.556269 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:26.563057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.563541 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.564021 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.564724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.565173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.565595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.686831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:26.687672 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:26.697704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.698433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.698980 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.699901 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.701583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.702457 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.759142 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:26.767304 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-10f61cee-d02c-40d8-b76d-34ecdc9a7c70 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1369 microversion: 2.1 time: 0.216061 Aug 29 21:29:26.768474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 166/346] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:26 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:26.853814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:26.854897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:26.863418 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.865628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.866442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.867252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:26.867788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:26.868320 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:26.876247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:26.885487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-26eaeebb-66db-4c2b-93a5-8fbc5866785f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.208154 Aug 29 21:29:26.886360 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 181/347] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:26 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:27.042691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:27.053619 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-aba68791-4a06-4f11-9925-fdaf7227134d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.212255 Aug 29 21:29:27.054240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 167/348] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:26 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:27.386759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:27.387455 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:27.394065 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:27.399438 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:27.399438 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:27.399438 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:27.399438 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:27.399795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:27.537206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:27.545770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0367b429-d72c-4ec1-b889-62206498e454 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.162869 Aug 29 21:29:27.546401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 182/349] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:27 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:27.789741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:27.791116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:27.798704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:27.799198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:27.799634 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:27.800371 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:27.800824 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:27.801249 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:27.907725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:27.908747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:27.924066 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:27.924511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:27.924947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:27.925657 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:27.926108 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:27.926531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:28.039155 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:28.051109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0fb98524-2430-4788-a8db-9681d2cb722f tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1560 microversion: 2.1 time: 0.263090 Aug 29 21:29:28.051109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 168/350] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:27 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:28.075865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:28.076843 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:28.085224 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:28.086004 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:28.087420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:28.088267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:28.089332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:28.097151 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:28.128151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:28.136580 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8607d68d-c311-4eea-946a-119afa97fb49 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.233594 Aug 29 21:29:28.140133 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 183/351] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:27 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:28.142645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:28.143404 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:28.149433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:28.149835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:28.150270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:28.150965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:28.151740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:28.152205 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:28.192873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f37e8ff8-f4f3-4415-85c7-415a3b5dce09 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125821 Aug 29 21:29:28.193774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 169/352] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:29:28 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:29:28.306667 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:28.319196 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-099a4375-a44f-41ac-98d5-7f4279169618 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.180481 Aug 29 21:29:28.320310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 184/353] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:28 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:28.565823 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:28.566427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:28.572657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:28.573194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:28.573631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:28.574332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:28.574870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:28.575277 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:28.785346 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:28.793409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3e485fe3-a315-4c7d-bd5f-5c5ca56cca3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.231322 Aug 29 21:29:28.793976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 170/354] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:28 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:29.159247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:29.159907 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:29.166645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.167135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.168012 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.168296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.168749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.169710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.309885 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:29.321940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-073a7cf0-a185-4efd-a7e2-668072712a32 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.167234 Aug 29 21:29:29.330373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 185/355] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:29 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:29.347112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:29.355013 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:29.362478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-02a7f7b4-9191-4b5e-8075-7d77cd643d05 req-b84a246c-a806-4f11-bd3d-49c91face99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47361729-1df7-4084-8819-76e4b8e43a1e", "tag": "81cd5932-3a95-43b6-86ae-902a62b744b9"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:29.364105 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.364682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.365208 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.366082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.366653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.367152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.372939 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-02a7f7b4-9191-4b5e-8075-7d77cd643d05 req-b84a246c-a806-4f11-bd3d-49c91face99d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.373408 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-02a7f7b4-9191-4b5e-8075-7d77cd643d05 req-b84a246c-a806-4f11-bd3d-49c91face99d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.373834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-02a7f7b4-9191-4b5e-8075-7d77cd643d05 req-b84a246c-a806-4f11-bd3d-49c91face99d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.386700 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-02a7f7b4-9191-4b5e-8075-7d77cd643d05 req-b84a246c-a806-4f11-bd3d-49c91face99d service nova] Creating event network-changed:81cd5932-3a95-43b6-86ae-902a62b744b9 for instance 47361729-1df7-4084-8819-76e4b8e43a1e on hv-cinder-85426 Aug 29 21:29:29.392735 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-02a7f7b4-9191-4b5e-8075-7d77cd643d05 req-b84a246c-a806-4f11-bd3d-49c91face99d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033789 Aug 29 21:29:29.393913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 186/356] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:29.507412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:29.515933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1373e870-32c1-448d-93b3-baedb1d4548f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.175064 Aug 29 21:29:29.516525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 171/357] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:29 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:29.738709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:29.739250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:29.745738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.746570 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.746701 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.747617 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.748120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.748619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.777296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-532e6a1b-6b71-4056-bee2-73921b87aa50 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/ips" status: 200 len: 151 microversion: 2.20 time: 0.042993 Aug 29 21:29:29.777879 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 187/358] 10.222.0.65 () {60 vars in 1289 bytes} [Mon Aug 29 21:29:29 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:29:29.814442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:29.815055 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:29.821689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.822058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.822495 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.823198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:29.823740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:29.827763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:29.831251 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:29.982782 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:29.990795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9c25c959-29b1-4f82-ad4b-580f07a192d7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.180197 Aug 29 21:29:29.991464 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 172/359] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:29 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:30.343433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:30.344168 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:30.350804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:30.351369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:30.351712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:30.352496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:30.352931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:30.353348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:30.519841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:30.528950 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ed88aa92-a650-487d-be1d-3f34a4c84bc6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.189888 Aug 29 21:29:30.534729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 188/360] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:30 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:30.553217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:30.553834 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:30.572950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:30.573447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:30.578410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:30.579537 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:30.580966 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:30.583837 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:31.013125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:31.013733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:31.019696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:31.020173 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:31.020605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:31.021332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:31.021790 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:31.022212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:31.049171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:31.057700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4b4a0223-5d71-40ec-a6d3-c14f3a55b5e9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.508250 Aug 29 21:29:31.058775 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 173/361] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:30 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:31.177941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:31.187570 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fbb0edbb-fe2b-4f51-9090-115fdb9ecf3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.178655 Aug 29 21:29:31.188781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 189/362] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:31 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:31.556292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:31.556814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:31.563841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:31.564379 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:31.569708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:31.569708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:31.569708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:31.569708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:31.706971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:31.715680 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-390022cf-b7c2-46d7-a086-a92d772bc4a9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.163568 Aug 29 21:29:31.718740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 174/363] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:31 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:32.080181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:32.080805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:32.087357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.087842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.088370 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.089310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.089766 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.090188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.209321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:32.210733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:32.219729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.220429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.227106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.227106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.227106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.227106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.246835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:32.256791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-445b9573-e7fd-4e52-ae36-a24aade827ea tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.182862 Aug 29 21:29:32.258041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 190/364] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:32 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:32.429439 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:32.437572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2cd2a0df-a7e0-4d75-bf03-b31a53504fd8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.231949 Aug 29 21:29:32.438152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 175/365] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:32 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:32.738721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:32.739427 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:32.746622 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.752486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.752486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.752486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.752486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.753000 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.864684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-85d03d73-0a69-4c1a-b27b-33d06b3b033c req-a5cd9ae6-924e-46cc-9bb6-eb331dff4600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd8e900-c6d1-40db-a1e7-ee9c3e703dff", "name": "network-vif-plugged", "status": "completed", "tag": "f7b98ffd-df0e-4679-b056-8aebb5b15590"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:32.879027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-85d03d73-0a69-4c1a-b27b-33d06b3b033c req-a5cd9ae6-924e-46cc-9bb6-eb331dff4600 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.879608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-85d03d73-0a69-4c1a-b27b-33d06b3b033c req-a5cd9ae6-924e-46cc-9bb6-eb331dff4600 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.880167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-85d03d73-0a69-4c1a-b27b-33d06b3b033c req-a5cd9ae6-924e-46cc-9bb6-eb331dff4600 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.893137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-85d03d73-0a69-4c1a-b27b-33d06b3b033c req-a5cd9ae6-924e-46cc-9bb6-eb331dff4600 service nova] Creating event network-vif-plugged:f7b98ffd-df0e-4679-b056-8aebb5b15590 for instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff on hv-cinder-85426 Aug 29 21:29:32.899389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-85d03d73-0a69-4c1a-b27b-33d06b3b033c req-a5cd9ae6-924e-46cc-9bb6-eb331dff4600 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040755 Aug 29 21:29:32.900496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 176/366] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:32.920291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:32.936106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2c33287f-7a7f-4b6b-9cbb-717dea6fb6c4 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.200940 Aug 29 21:29:32.936394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 191/367] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:32 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:32.950962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:32.953773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:32.963215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.963721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.964653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.965612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:32.966552 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:32.966993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:32.996323 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lazy-loading 'flavor' on Instance uuid 8ce9c011-918f-4702-83d6-cd5fd83a1a3a {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:29:33.278979 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:33.279920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:33.286408 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.286891 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.287327 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:33.288260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.288875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.289300 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:33.433897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:33.443818 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-50d4be35-2e81-4e3b-811d-f150b7a8974e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.168695 Aug 29 21:29:33.444460 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 192/368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:33 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:33.460896 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:33.461558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:33.469523 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.470676 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.470676 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:33.471353 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.471968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.472395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:33.611140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:33.618900 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9d630822-6bac-4a43-b11d-7529416d68d5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.163845 Aug 29 21:29:33.619552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 193/369] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:33 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:33.688758 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a6523941-3448-4a79-985d-b96bc1028113 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/action" status: 202 len: 0 microversion: 2.20 time: 0.749968 Aug 29 21:29:33.689613 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 177/370] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Aug 29 21:29:32 2022] POST /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:29:33.697868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:33.698897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:33.706707 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.707191 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.707621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:33.708380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.708831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.709244 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:33.848237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:33.857493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:33.859134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:33.860426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b244a720-9ab3-415c-b561-d2e4beaf1588 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.166533 Aug 29 21:29:33.860941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 194/371] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:33 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:33.958627 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:33.959449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:33.966628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.967121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.967559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:33.968280 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:33.968735 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:33.969156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.104962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:34.114502 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5ed3f649-04d7-49c8-83ff-deb7e7d6e4c6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.161039 Aug 29 21:29:34.115069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 178/372] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:33 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:34.465842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:34.466564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:34.473646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:34.474128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:34.474580 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.475291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:34.475746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:34.476209 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.480452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:34.620313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:34.632944 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1fa10bae-9b39-4ce7-90d1-0c151fa79253 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1358 microversion: 2.1 time: 0.171093 Aug 29 21:29:34.641133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:34.641728 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 195/373] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:34 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:34.641919 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:34.653621 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:34.654150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:34.654737 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.655553 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:34.656063 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:34.656522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.817160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:34.826484 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f0a24907-8975-4b4c-8a69-dd17541c673a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.189999 Aug 29 21:29:34.827157 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 179/374] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:34 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:34.883535 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:34.884181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:34.891233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:34.891727 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:34.892190 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.892889 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:34.893346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:34.894419 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.917153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-b608042a-afa0-42e3-a666-d965cc1de15f req-d41bbd6b-a340-4af7-93b4-072903d2568d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28cecc9-0a87-4560-a3de-51196dcc5ad6", "name": "network-vif-plugged", "status": "completed", "tag": "3b0e05e5-994d-4858-af60-4b00e1a3aedf"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:34.927598 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b608042a-afa0-42e3-a666-d965cc1de15f req-d41bbd6b-a340-4af7-93b4-072903d2568d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:34.928130 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b608042a-afa0-42e3-a666-d965cc1de15f req-d41bbd6b-a340-4af7-93b4-072903d2568d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:34.928663 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b608042a-afa0-42e3-a666-d965cc1de15f req-d41bbd6b-a340-4af7-93b4-072903d2568d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:34.942591 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-b608042a-afa0-42e3-a666-d965cc1de15f req-d41bbd6b-a340-4af7-93b4-072903d2568d service nova] Creating event network-vif-plugged:3b0e05e5-994d-4858-af60-4b00e1a3aedf for instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 on hv-cinder-85426 Aug 29 21:29:34.949134 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-b608042a-afa0-42e3-a666-d965cc1de15f req-d41bbd6b-a340-4af7-93b4-072903d2568d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035887 Aug 29 21:29:34.950898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 180/375] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:29:35.067458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:35.078483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:35.080148 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:35.082089 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ea6e9c86-8383-4c43-8206-5bc00c4ba986 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.202255 Aug 29 21:29:35.082881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 196/376] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:34 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:35.136346 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:35.137045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:35.144022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.144816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.145249 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.145958 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.146449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.146881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.296301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:35.304832 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-35ae2d12-03d2-4d72-80e7-f306962e2b83 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.172835 Aug 29 21:29:35.305410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 181/377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:35 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:35.655307 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:35.656083 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:35.662659 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.663147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.663578 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.664334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.664783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.665202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.795854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:35.803709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-74614399-57d1-41c0-810b-e5eabde9b7e7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1548 microversion: 2.1 time: 0.153033 Aug 29 21:29:35.804310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 197/378] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:35 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:35.824283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:35.824873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:35.831905 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.832400 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.832836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.833536 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.833992 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.834577 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.850593 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:35.851255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:35.857294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.857778 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.858211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.858911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:35.859363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:35.859783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:35.991342 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.000437 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c5b583e8-6629-4e2d-94b5-09500b13e9ba tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1548 microversion: 2.1 time: 0.180226 Aug 29 21:29:36.001266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 182/379] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:35 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:36.013846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.021578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:36.025583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3f6123b8-a067-4765-bc85-e2536a978575 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.179042 Aug 29 21:29:36.029006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 198/380] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:35 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:36.029172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.029172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Searching by: {'deleted': False, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da'} {{(pid=121559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 21:29:36.035392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.035866 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.036449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.037160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.037608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.038020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.105521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:36.106168 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:36.112088 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.112574 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.113004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.113693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.114144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.114565 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.129401 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.multi_cell_list [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 21:29:36.229828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2ee5e6b1-a851-490d-9025-bdcb8caa61f0 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211854 Aug 29 21:29:36.230422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 183/381] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Aug 29 21:29:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:29:36.242595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:36.243276 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:36.250005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.250427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.250859 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.251565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.252055 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.252414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.252550 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.261215 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.262786 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.264730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-65a271ee-b5bf-40fe-9e13-51b32e4115b4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.163067 Aug 29 21:29:36.281599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 199/382] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:36 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:29:36.327546 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:36.328331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:36.334981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.335462 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.335902 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.336678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:36.337123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:36.337546 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:36.392787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.400688 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-67127acf-1b4c-4d0f-ac49-b09ae4b0ed08 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1548 microversion: 2.1 time: 0.161929 Aug 29 21:29:36.401258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 184/383] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:36 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:36.474381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:36.483085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e68375e5-b246-4aa6-9cbc-1b5e73bb2037 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1722 microversion: 2.1 time: 0.160273 Aug 29 21:29:36.483658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 200/384] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:36 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:37.047773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:37.048395 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:37.055309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:37.055801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:37.056286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:37.057718 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:37.058357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:37.058788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:37.247747 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:37.249888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c119357d-6671-4a58-83d7-e3b90389e084 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1367 microversion: 2.1 time: 0.206735 Aug 29 21:29:37.250463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 185/385] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:37 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:37.292556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:37.293245 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:37.299946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:37.300424 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:37.300934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:37.301539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:37.301984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:37.302404 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:37.446385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:37.455471 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:37.456929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:37.463794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8e33384d-0a02-497c-86e5-0aff2d091c1f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.169530 Aug 29 21:29:37.463794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 201/386] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:37 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:37.504718 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:37.505354 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:37.511494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:37.512036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:37.512563 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:37.514227 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:37.514716 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:37.515138 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:37.717311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:37.725815 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d572df77-f7f7-4897-b06c-9995d6f36452 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1699 microversion: 2.1 time: 0.225067 Aug 29 21:29:37.732101 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 186/387] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:37 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1699 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:37.747804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-63ce6122-01cd-4705-a74a-af5ce939eaac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:37.754536 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63ce6122-01cd-4705-a74a-af5ce939eaac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:37.755016 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63ce6122-01cd-4705-a74a-af5ce939eaac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:37.755439 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63ce6122-01cd-4705-a74a-af5ce939eaac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:37.819637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-63ce6122-01cd-4705-a74a-af5ce939eaac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Going to try to start instance {{(pid=121558) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:29:38.136325 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-63ce6122-01cd-4705-a74a-af5ce939eaac tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action" status: 202 len: 0 microversion: 2.1 time: 0.390102 Aug 29 21:29:38.136325 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 202/388] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:29:37 2022] POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:29:38.145747 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:38.146351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:38.153246 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.154547 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.155051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.156010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.156535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.156963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.273007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:38.274157 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:38.283077 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.284104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.284927 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.285955 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.286480 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.287122 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.292809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:38.295745 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:38.306969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ef2df7ff-1557-4043-be70-221808c9ab58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1708 microversion: 2.1 time: 0.165578 Aug 29 21:29:38.309851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 187/389] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:38 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:38.476667 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:38.486629 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7209447c-4111-44ce-bb93-e9b8c23e621a"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:38.487850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-322e0d19-8c70-4068-8621-f4a581c4a8a4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1557 microversion: 2.1 time: 0.219611 Aug 29 21:29:38.490714 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:38.498529 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.499012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.499732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.500475 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.502167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 203/390] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:38 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:38.502363 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.502793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.511832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:38.513307 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:38.519748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.528419 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.528419 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.528419 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.528419 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.529340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.706933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:38.716785 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:38.718512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:38.720056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-43922218-0f16-45a7-ab3a-a34c473cbcac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.212528 Aug 29 21:29:38.728482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 204/391] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:38 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:38.728482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:38.728482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:38.733992 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.734483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.734941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.735656 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:38.736146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:38.736849 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:38.825607 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-775b04a0-587e-407c-87b8-2e0b098d2fb7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103303 Aug 29 21:29:38.826645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 205/392] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:29:38 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:39.334611 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:39.335445 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:39.342753 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:39.343235 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:39.343663 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:39.344416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:39.345032 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:39.345464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:39.517792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:39.527342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-52a5fb61-82bd-40b7-9828-783fbb6d46d9 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1708 microversion: 2.1 time: 0.200770 Aug 29 21:29:39.528349 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 206/393] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:39 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1708 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:39.598174 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1e1819d9-08af-4427-9c2d-cbb8bb9cc925 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116124 Aug 29 21:29:39.599238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 188/394] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:29:38 2022] POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments => generated 194 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:29:39.743452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:39.744090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:39.750937 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:39.751183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:39.751599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:39.752333 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:39.752779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:39.753202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:39.920997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:39.929574 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:39.930997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:39.932444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-414190a2-344c-4cc1-bbe5-ef1f9cbd61b6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.192921 Aug 29 21:29:39.933004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 207/395] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:39 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:40.426791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-d04e8013-8f0d-4f11-9bd6-7836bed4ab63 req-694ddcda-7262-4616-b221-331ebed2604e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28cecc9-0a87-4560-a3de-51196dcc5ad6", "tag": "3b0e05e5-994d-4858-af60-4b00e1a3aedf"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:40.431655 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:40.437601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d04e8013-8f0d-4f11-9bd6-7836bed4ab63 req-694ddcda-7262-4616-b221-331ebed2604e service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:40.438121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d04e8013-8f0d-4f11-9bd6-7836bed4ab63 req-694ddcda-7262-4616-b221-331ebed2604e service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:40.438559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d04e8013-8f0d-4f11-9bd6-7836bed4ab63 req-694ddcda-7262-4616-b221-331ebed2604e service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:40.453981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-d04e8013-8f0d-4f11-9bd6-7836bed4ab63 req-694ddcda-7262-4616-b221-331ebed2604e service nova] Creating event network-changed:3b0e05e5-994d-4858-af60-4b00e1a3aedf for instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 on hv-cinder-85426 Aug 29 21:29:40.458940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-d04e8013-8f0d-4f11-9bd6-7836bed4ab63 req-694ddcda-7262-4616-b221-331ebed2604e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036656 Aug 29 21:29:40.459536 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 189/396] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:40.552379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:40.552960 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:40.560076 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:40.561079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:40.561307 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:40.562010 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:40.562463 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:40.562965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:40.730352 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:40.739243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-86b5a9b7-4b87-4a5d-8a5c-b24c01159736 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1708 microversion: 2.1 time: 0.190593 Aug 29 21:29:40.739837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 208/397] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:40 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1708 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:40.965398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:40.967956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:40.980267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:40.981956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:40.982678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:40.983644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:40.984219 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:40.984795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:41.213511 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:41.223184 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:41.224962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:41.226333 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-35fb53c7-e083-4715-980b-783e594127b0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.273079 Aug 29 21:29:41.227466 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 190/398] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:40 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:41.769023 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:41.770844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:41.778936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:41.779407 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:41.787361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:41.787361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:41.787361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:41.787361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:41.926183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:41.934365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8e0dbce8-331a-42fc-a828-6c612b464a7d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1712 microversion: 2.1 time: 0.170725 Aug 29 21:29:41.935030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 209/399] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:41 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1712 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:42.250752 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:42.251317 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:42.258123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:42.258607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:42.259043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:42.259751 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:42.260235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:42.260707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:42.397854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:42.405983 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:42.407399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:42.408603 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2414be5c-30f4-4131-948f-fae525d4cddb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.162586 Aug 29 21:29:42.409207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 191/400] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:42 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:43.431229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:43.431767 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:43.438761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:43.439237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:43.439665 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:43.440369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:43.440814 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:43.441230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:43.571972 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:43.581150 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:43.582638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:43.583846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-86734708-a1e2-4fee-ae16-ef5d91e5da6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.156588 Aug 29 21:29:43.584458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 210/401] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:43 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:44.608507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:44.609114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:44.615628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:44.616137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:44.616570 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:44.617261 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:44.617711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:44.618135 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:44.749709 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:44.757840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:44.759297 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:44.760474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-75b7e423-dc93-4164-ba5f-73248cc14718 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.156528 Aug 29 21:29:44.761041 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 192/402] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:44 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:29:45.782789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:45.783398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:45.789947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:45.790428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:45.790864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:45.791556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:45.792045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:45.792475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:45.797362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:45.925762 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:45.933795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:45.935216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:45.936470 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3c1caeb2-d046-4fcd-8bff-2b283860f0b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.157660 Aug 29 21:29:45.936968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 211/403] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:45 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:46.959311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:46.960101 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:46.962380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:46.967921 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:46.968410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:46.968848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:46.969616 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:46.970071 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:46.970489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:47.107771 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:47.116643 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:47.118083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:47.119311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-48799d0f-57fc-44ef-9b7d-a397369becb1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.164219 Aug 29 21:29:47.119865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 193/404] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:46 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:48.143402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:48.144114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:48.150959 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:48.151594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:48.152121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:48.152897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:48.153422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:48.153911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:48.271391 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:48.272197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:48.280014 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:48.280517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:48.280958 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:48.281697 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:48.282137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:48.283434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:48.303510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:48.312803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:48.314587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:48.315850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0364ec48-c699-4b23-898e-f2cf90dcdc3d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.176600 Aug 29 21:29:48.316457 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 212/405] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:48 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:48.426286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:48.435068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-239309a5-5f9d-43ec-9628-3dc1bd7dc71a tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1594 microversion: 2.1 time: 0.167055 Aug 29 21:29:48.435647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 194/406] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:48 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:49.338654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:49.339536 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:49.347318 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:49.347903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:49.348492 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:49.349356 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:49.349809 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:49.350228 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:49.597773 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:49.603559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:49.605311 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:49.606576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-340c829d-53e8-4869-a506-0850cb2b9f36 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.271863 Aug 29 21:29:49.607322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 213/407] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:49 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:50.629290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:50.630060 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:50.636857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:50.637341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:50.637773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:50.638744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:50.639211 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:50.639671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:50.777590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:50.787604 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:50.789258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:50.790318 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d2b049d2-cad8-4ed2-9a32-2f32d1248fe0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.164957 Aug 29 21:29:50.791109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 195/408] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:50 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:50.818167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-31a0b03f-bd44-49ef-b4ff-a6bd10d15803 req-91fa526f-7fcb-47fc-abf7-52868c239a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd8e900-c6d1-40db-a1e7-ee9c3e703dff", "tag": "f7b98ffd-df0e-4679-b056-8aebb5b15590"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:50.830105 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-31a0b03f-bd44-49ef-b4ff-a6bd10d15803 req-91fa526f-7fcb-47fc-abf7-52868c239a60 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:50.830979 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-31a0b03f-bd44-49ef-b4ff-a6bd10d15803 req-91fa526f-7fcb-47fc-abf7-52868c239a60 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:50.831678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-31a0b03f-bd44-49ef-b4ff-a6bd10d15803 req-91fa526f-7fcb-47fc-abf7-52868c239a60 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:50.845504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-31a0b03f-bd44-49ef-b4ff-a6bd10d15803 req-91fa526f-7fcb-47fc-abf7-52868c239a60 service nova] Creating event network-changed:f7b98ffd-df0e-4679-b056-8aebb5b15590 for instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff on hv-cinder-85426 Aug 29 21:29:50.852250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-31a0b03f-bd44-49ef-b4ff-a6bd10d15803 req-91fa526f-7fcb-47fc-abf7-52868c239a60 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037911 Aug 29 21:29:50.852968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 214/409] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:51.814048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:51.814721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:51.821499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:51.821977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:51.822406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:51.823106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:51.823546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:51.823991 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:51.968416 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:51.977858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:51.979305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:51.980497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c223cdcd-0874-4665-87e5-d5ec9113fcca tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.170995 Aug 29 21:29:51.982499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 196/410] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:51 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:53.007257 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:53.007870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:53.014240 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:53.022039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:53.022475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:53.023171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:53.023620 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:53.024080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:53.162025 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:53.170630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:53.172100 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:53.173259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-52265b5d-ea21-420e-9d6d-9f5620179fba tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.171267 Aug 29 21:29:53.173825 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 215/411] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:53 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:54.199243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:54.200677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:54.208997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:54.209588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:54.210227 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:54.211181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:54.211757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:54.212307 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:54.243617 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1801222901"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:54.244564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:54.255404 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:54.258639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:54.258639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:54.258639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:54.259174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:54.260055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:54.405238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:54.414341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:54.418113 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:54.418113 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7f8ce480-c481-48ef-a160-b8a0b8321ce2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.222404 Aug 29 21:29:54.418113 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 197/412] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:54 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:29:54.428417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.network.security_group_api [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Adding security group 0acf2c5f-488f-47e0-8f71-43ae4ca4cd6c to port f7b98ffd-df0e-4679-b056-8aebb5b15590 Aug 29 21:29:55.084634 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-feffc0ce-011d-4c93-9ce0-b11daf3a333d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/action" status: 202 len: 0 microversion: 2.1 time: 0.844601 Aug 29 21:29:55.085809 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 216/413] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:29:54 2022] POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:29:55.096969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-cd2f37e3-f5da-4e79-8431-f1f59689a7f6 req-c31132b8-e0a9-4d4d-a2d9-d5df40e20f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd8e900-c6d1-40db-a1e7-ee9c3e703dff", "tag": "f7b98ffd-df0e-4679-b056-8aebb5b15590"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:55.100847 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:55.102354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:55.113391 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=82 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:55.116509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:55.117519 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:55.118647 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:55.119129 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-cd2f37e3-f5da-4e79-8431-f1f59689a7f6 req-c31132b8-e0a9-4d4d-a2d9-d5df40e20f4a service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:55.120051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-cd2f37e3-f5da-4e79-8431-f1f59689a7f6 req-c31132b8-e0a9-4d4d-a2d9-d5df40e20f4a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:55.120822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-cd2f37e3-f5da-4e79-8431-f1f59689a7f6 req-c31132b8-e0a9-4d4d-a2d9-d5df40e20f4a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:55.121359 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:55.122683 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:55.124239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:55.154385 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-cd2f37e3-f5da-4e79-8431-f1f59689a7f6 req-c31132b8-e0a9-4d4d-a2d9-d5df40e20f4a service nova] Creating event network-changed:f7b98ffd-df0e-4679-b056-8aebb5b15590 for instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff on hv-cinder-85426 Aug 29 21:29:55.170708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-cd2f37e3-f5da-4e79-8431-f1f59689a7f6 req-c31132b8-e0a9-4d4d-a2d9-d5df40e20f4a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075136 Aug 29 21:29:55.170708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 198/414] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:29:55.371250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:55.388416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4c76b7b0-89c3-4386-91e0-b2015dd2fb18 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1760 microversion: 2.1 time: 0.294077 Aug 29 21:29:55.389469 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 217/415] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:29:55 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1760 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:55.443413 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:55.445236 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:55.457189 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:55.458154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:55.459217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:55.460867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:55.462108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:55.463160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:55.756701 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:55.774494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:55.777434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:55.778990 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d391d25d-47e7-4134-991c-444158905c4e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1745 microversion: 2.20 time: 0.341179 Aug 29 21:29:55.779799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 199/416] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:55 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1745 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:56.807421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:56.808073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:56.816007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:56.819127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:56.819127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:56.819127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:56.819127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:56.819682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:57.002302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:57.002302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:57.002595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:57.002595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-14ce2b03-2c34-4430-a760-bf987cb16aa8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1745 microversion: 2.20 time: 0.198209 Aug 29 21:29:57.002595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 218/417] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:56 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:58.038952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:58.039566 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:58.048019 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:58.048422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:58.048927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:58.049739 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:58.050342 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:58.050625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:58.217586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:58.227947 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:58.229425 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:58.231517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-374acea7-d891-4b86-92bb-9098970c78ac tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.195980 Aug 29 21:29:58.232714 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 200/418] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:58 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:58.795877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-ee447518-d8e8-4fa5-bc7f-6a7c6e9ec206 req-2995e02b-0e19-42d5-895b-eb5c1c56bf98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9c011-918f-4702-83d6-cd5fd83a1a3a", "name": "network-vif-plugged", "status": "completed", "tag": "7d00a0ed-45ea-43c9-98bc-7122049be3a0"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:29:58.806636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ee447518-d8e8-4fa5-bc7f-6a7c6e9ec206 req-2995e02b-0e19-42d5-895b-eb5c1c56bf98 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:58.807321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ee447518-d8e8-4fa5-bc7f-6a7c6e9ec206 req-2995e02b-0e19-42d5-895b-eb5c1c56bf98 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:58.807851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ee447518-d8e8-4fa5-bc7f-6a7c6e9ec206 req-2995e02b-0e19-42d5-895b-eb5c1c56bf98 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:58.825937 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-ee447518-d8e8-4fa5-bc7f-6a7c6e9ec206 req-2995e02b-0e19-42d5-895b-eb5c1c56bf98 service nova] Creating event network-vif-plugged:7d00a0ed-45ea-43c9-98bc-7122049be3a0 for instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a on hv-cinder-85426 Aug 29 21:29:58.828857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-ee447518-d8e8-4fa5-bc7f-6a7c6e9ec206 req-2995e02b-0e19-42d5-895b-eb5c1c56bf98 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037732 Aug 29 21:29:58.830256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 219/419] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:59.263986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:59.265285 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:29:59.274116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:59.274607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:59.275049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:59.275757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:29:59.276272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:29:59.276697 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:29:59.464012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:59.484357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:59.486063 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:29:59.487487 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-af33e4fe-ca09-4ecd-aa95-91b705d8e20a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.228570 Aug 29 21:29:59.488147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 201/420] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:29:59 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:00.517522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:00.518749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:00.529967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:00.530825 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:00.531390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:00.532212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:00.532682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:00.533227 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:00.691245 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:00.700332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:00.701854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:00.703070 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-06dd9e6a-4d4b-487d-9ddb-600b8463cc1b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.195037 Aug 29 21:30:00.703636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 220/421] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:00 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:01.731724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:01.732898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:01.747295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:01.748527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:01.749868 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:01.751946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:01.752653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:01.753238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:01.957912 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:01.972540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:01.974692 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:01.978797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ebd5e18a-2e22-4157-adab-9b92f86f53a8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.254277 Aug 29 21:30:01.980854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 202/422] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:01 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:03.024385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:03.032729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:03.062936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:03.063555 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:03.064151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:03.064877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:03.065337 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:03.065780 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:03.244483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:03.265807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:03.269222 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:03.271781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5301762c-0f25-448f-95c8-dc7b56deea6d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.264033 Aug 29 21:30:03.273775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 221/423] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:03 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:04.297802 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:04.298719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:04.305814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:04.306310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:04.306762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:04.307467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:04.307948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:04.308383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:04.466816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:04.475434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:04.476975 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:04.478109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-869ec9da-5966-474a-aa97-b5d5fba2868c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.184719 Aug 29 21:30:04.478666 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 203/424] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:04 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:05.510693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:05.512282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:05.520765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:05.521682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:05.522220 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:05.523133 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:05.523675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:05.524151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:05.764002 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:05.780764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:05.783705 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:05.785944 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-16320078-c948-4466-b3e6-6f307b131fe7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.279617 Aug 29 21:30:05.787459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 222/425] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:05 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:06.821820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:06.825350 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:06.837612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:06.838963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:06.840306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:06.842505 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:06.843585 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:06.844945 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:06.876282 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:07.104932 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:07.125381 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:07.128210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:07.129822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-aa8e7d96-c321-49bc-a882-b3f674116d61 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.321807 Aug 29 21:30:07.130902 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 204/426] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:06 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:08.156150 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:08.157516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:08.170198 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:08.174777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:08.175874 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:08.177321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:08.178206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:08.179020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:08.357922 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:08.368333 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:08.371983 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:08.371983 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8452ce5b-a4f4-467b-8d51-f9280dffeaec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.220857 Aug 29 21:30:08.372327 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 223/427] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:08 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:09.401148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:09.402250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:09.415489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:09.416308 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:09.416857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:09.418087 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:09.418896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:09.419632 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:09.606867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:09.616378 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:09.621985 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:09.621985 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a9839db0-772b-415c-8906-315ad7cdcd4c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1740 microversion: 2.20 time: 0.227571 Aug 29 21:30:09.623279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 205/428] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:09 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:10.656586 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:10.657527 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:10.665047 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:10.665589 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:10.666031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:10.666755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:10.667215 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:10.667684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:10.842152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:10.853482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:10.856840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:10.858356 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9ee9e9cc-10e1-4860-ac71-8726ab340b38 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1722 microversion: 2.20 time: 0.207723 Aug 29 21:30:10.859504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 224/429] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:10 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:11.899197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:11.899851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:11.902765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=34 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:11.907855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:11.908414 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:11.908874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:11.909595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:11.910047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:11.910466 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:12.060749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:12.070412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:12.071931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:12.073223 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4de67390-2a05-46df-96be-2a5cd0adc568 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1722 microversion: 2.20 time: 0.178139 Aug 29 21:30:12.073880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 206/430] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:11 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:13.098513 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:13.099161 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:13.108406 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:13.108893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:13.109329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:13.110049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:13.110494 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:13.110913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:13.282187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:13.292375 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:13.295381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:13.295381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fd79083a-323e-44c9-ae86-51516bfa0e00 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1722 microversion: 2.20 time: 0.201157 Aug 29 21:30:13.296226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 225/431] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:13 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:14.323222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:14.323968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:14.331794 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:14.332334 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:14.332763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:14.333510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:14.333961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:14.334459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:14.483181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:14.492233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:14.493711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:14.494921 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-63f2f413-a0e8-4089-9258-5b487f96fd76 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1725 microversion: 2.20 time: 0.176038 Aug 29 21:30:14.495506 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 207/432] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:14 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:14.520531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "939de495-537b-4327-86da-3dd0cefd5754"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:14.522914 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:14.530356 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:14.530825 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:14.531278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:14.532025 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:14.532478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:14.532904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:14.856929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-ac5b2293-1d89-4963-863c-09ab76ef3a69 req-fa0d3695-b60d-4093-bd3c-560f85ca80b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9c011-918f-4702-83d6-cd5fd83a1a3a", "name": "network-vif-unplugged", "status": "completed", "tag": "7d00a0ed-45ea-43c9-98bc-7122049be3a0"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:14.875281 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-ac5b2293-1d89-4963-863c-09ab76ef3a69 req-fa0d3695-b60d-4093-bd3c-560f85ca80b4 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:14.876054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-ac5b2293-1d89-4963-863c-09ab76ef3a69 req-fa0d3695-b60d-4093-bd3c-560f85ca80b4 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:14.876771 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-ac5b2293-1d89-4963-863c-09ab76ef3a69 req-fa0d3695-b60d-4093-bd3c-560f85ca80b4 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:14.896947 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-ac5b2293-1d89-4963-863c-09ab76ef3a69 req-fa0d3695-b60d-4093-bd3c-560f85ca80b4 service nova] Creating event network-vif-unplugged:7d00a0ed-45ea-43c9-98bc-7122049be3a0 for instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a on hv-cinder-85426 Aug 29 21:30:14.905360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-ac5b2293-1d89-4963-863c-09ab76ef3a69 req-fa0d3695-b60d-4093-bd3c-560f85ca80b4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058283 Aug 29 21:30:14.908717 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 208/433] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:30:15.681744 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:15.771779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-51998ec4-a849-4c24-bbdf-e29273e9ee97 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.255509 Aug 29 21:30:15.772484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 226/434] 10.222.0.65 () {62 vars in 1364 bytes} [Mon Aug 29 21:30:14 2022] POST /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments => generated 188 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:30:15.919521 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:15.920362 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:15.927407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:15.927922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:15.928353 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:15.929064 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:15.929513 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:15.929943 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:15.983045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121559) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:30:16.381233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-69d45037-78f1-41bd-88c0-40d9fbedb3b9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/action" status: 202 len: 0 microversion: 2.20 time: 0.467467 Aug 29 21:30:16.381866 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 209/435] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Aug 29 21:30:15 2022] POST /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:30:16.396840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:16.397966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:16.410621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:16.411497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:16.412257 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:16.413509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:16.414328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:16.415094 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:16.624288 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:16.637127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:16.639071 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:16.640393 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-91c5ac72-ea5c-4525-a96b-050393ce5270 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1751 microversion: 2.20 time: 0.251260 Aug 29 21:30:16.640967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 227/436] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:16 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1751 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:17.665744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:17.666394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:17.674536 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:17.675027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:17.675463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:17.676212 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:17.676667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:17.677094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:17.848288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:17.860849 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:17.862604 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:17.863977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d767ac10-d5a6-433c-87cf-813552499593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1751 microversion: 2.20 time: 0.203241 Aug 29 21:30:17.869515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 210/437] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:17 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:18.889645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:18.890649 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:18.899626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:18.900367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:18.900974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:18.901777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:18.902476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:18.903144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:19.441791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:19.452442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:19.454585 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:19.456179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8ba86192-0f0a-4f75-9de0-a9bbfb387f6b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1753 microversion: 2.20 time: 0.571835 Aug 29 21:30:19.456975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 228/438] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:18 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1753 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:20.497375 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:20.497375 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:20.503202 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:20.503686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:20.504148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:20.504858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:20.505312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:20.505730 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:20.704885 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:20.715471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:20.716952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:20.718329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-365effc3-b2ef-4527-ab14-5155f5bf4991 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1753 microversion: 2.20 time: 0.227063 Aug 29 21:30:20.719289 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 211/439] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:20 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1753 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:21.743223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:21.743928 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:21.751092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:21.751575 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:21.752034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:21.752753 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:21.753208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:21.753628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:21.937090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:21.953890 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:21.957531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:21.959872 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7d9de20a-4b45-4476-92cf-cfd182241338 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.220649 Aug 29 21:30:21.960975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 229/440] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:21 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:23.003281 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:23.005267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:23.019349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:23.020277 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:23.021388 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:23.023043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:23.023666 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:23.024356 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:23.239453 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:23.253389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:23.257068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:23.259460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1d293fbb-edd2-40fe-8b3c-6fed54c1f1a0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.263867 Aug 29 21:30:23.261120 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 212/441] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:22 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:24.293879 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:24.301750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:24.314846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:24.315927 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:24.316526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:24.317422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:24.318059 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:24.318477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:24.560536 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:24.573984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:24.576411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:24.577816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ac1ded61-feec-4a6a-9014-2c70133e08eb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.295885 Aug 29 21:30:24.578557 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 230/442] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:24 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:24.988442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0340c9de-ec52-437f-9554-10c816aab59e"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:24.993968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:25.005857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:25.006625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:25.007308 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:25.008502 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:25.009230 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:25.009887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:25.618216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:25.619558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:25.622603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=28 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:25.630699 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:25.631518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:25.632271 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:25.633499 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:25.634299 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:25.634969 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:25.830326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:25.842151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:25.844014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:25.845508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c42d09c9-52ed-4354-8a65-f005db4fc52d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.232150 Aug 29 21:30:25.846447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 231/443] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:25 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:26.877031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:26.877861 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:26.886760 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:26.887092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:26.887528 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:26.888282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:26.888731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:26.889183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:27.101296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:27.137464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:27.139058 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:27.141279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c76a9401-ac1e-4faf-b895-d9ede974e053 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.268433 Aug 29 21:30:27.142191 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 232/444] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:26 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:27.559851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:27.567074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:27.572498 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:27.573354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:27.574712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:27.576062 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:27.576894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:27.577662 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:27.638637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c96ff095-b3ef-421c-8e6b-df2df4dcc31f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6/ips" status: 200 len: 150 microversion: 2.1 time: 0.087144 Aug 29 21:30:27.648335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 233/445] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:30:27 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6/ips => generated 150 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:30:27.664095 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d121139-dcde-49d3-bb97-6dca1ca0ff59"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:27.669531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:27.681496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:27.682775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:27.684736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:27.686048 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:27.687480 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:27.688397 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:27.859468 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Invalid volume: volume 8d121139-dcde-49d3-bb97-6dca1ca0ff59 is already attached to instances: 979806e6-6c73-40b1-a798-731653815edc Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: POST /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6/os-volume_attachments HTTP/1.1 Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 74 Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:30:27.867219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {"volumeAttachment": {"volumeId": "8d121139-dcde-49d3-bb97-6dca1ca0ff59"}} Aug 29 21:30:27.869835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Invalid volume: volume 8d121139-dcde-49d3-bb97-6dca1ca0ff59 is already attached to instances: 979806e6-6c73-40b1-a798-731653815edc Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'server_id': 'c28cecc9-0a87-4560-a3de-51196dcc5ad6', 'body': {'volumeAttachment': {'volumeId': '8d121139-dcde-49d3-bb97-6dca1ca0ff59'}}} Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8d121139-dcde-49d3-bb97-6dca1ca0ff59 is already attached to instances: 979806e6-6c73-40b1-a798-731653815edc Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:27.871912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8d121139-dcde-49d3-bb97-6dca1ca0ff59 is already attached to instances: 979806e6-6c73-40b1-a798-731653815edc Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:27.874110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8d121139-dcde-49d3-bb97-6dca1ca0ff59 is already attached to instances: 979806e6-6c73-40b1-a798-731653815edc Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 400 to user: Invalid volume: volume 8d121139-dcde-49d3-bb97-6dca1ca0ff59 is already attached to instances: 979806e6-6c73-40b1-a798-731653815edc {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ca98f031-c6df-4d96-a722-8cb1264295dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.214550 Aug 29 21:30:27.878270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 234/446] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:30:27 2022] POST /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6/os-volume_attachments => generated 174 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:30:27.881448 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:27.884040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:27.892902 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:27.893396 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:27.893832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:27.894615 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:27.895007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:27.895428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:28.520105 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6eec3e34-4586-41a8-8854-7dfd2d6d05c9 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/action" status: 202 len: 0 microversion: 2.1 time: 0.641927 Aug 29 21:30:28.522336 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 235/447] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:30:27 2022] POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:30:28.534368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:28.535466 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:28.549901 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:28.558637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:28.558637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:28.558637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:28.558637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:28.559316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:28.596258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:30:29.355359 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9035b7b0-40c7-4e43-8d2d-f64f7fbb954e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 204 len: 0 microversion: 2.1 time: 0.830027 Aug 29 21:30:29.357240 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 236/448] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:30:28 2022] DELETE /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:30:29.373799 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:29.393422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:29.393422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:29.393422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:29.393422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:29.394072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:29.394072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:29.394072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:29.601183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:29.611120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:29.612504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:29.613723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d79697c3-7730-4540-8eec-549610a7013f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.249612 Aug 29 21:30:29.614281 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 237/449] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:29 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:29.619107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:29.619713 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:29.627489 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:29.628060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:29.628296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:29.629056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:29.629696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:29.629965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:29.852951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:29.864130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-aa871be8-a896-4314-8fe7-2f5c08c75d3e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1752 microversion: 2.1 time: 0.248408 Aug 29 21:30:29.865014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 238/450] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:29 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:29.869566 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:29.870166 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:29.879803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:29.880323 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:29.880755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:29.881475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:29.881993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:29.882421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:30.074669 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:30.086342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-05584ae2-2b5e-4862-b798-e037497ce140 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1682 microversion: 2.1 time: 0.220379 Aug 29 21:30:30.087324 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 239/451] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:29 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:30.641909 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:30.642890 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:30.649005 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:30.649487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:30.649918 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:30.650699 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:30.651147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:30.651566 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:30.854581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:30.870361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:30.873780 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:30.876467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-64a6d4d3-addf-4b60-932e-946cf25f8157 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.237875 Aug 29 21:30:30.877867 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 240/452] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:30 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:30.890861 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:30.891534 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:30.901936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:30.902633 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:30.903377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:30.904575 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:30.905329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:30.906042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:30.947114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:31.119049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lazy-loading 'services' on Instance uuid 528c748a-ba74-44e6-b1a7-84ab068acfcb {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:30:31.923992 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6ac54f3b-5a97-4dde-811c-51136ec2e679 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-volume_attachments/8f1eb04a-93b1-4ea7-8327-b5616b78f70e" status: 202 len: 0 microversion: 2.1 time: 1.044146 Aug 29 21:30:31.926541 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 241/453] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:30:30 2022] DELETE /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-volume_attachments/8f1eb04a-93b1-4ea7-8327-b5616b78f70e => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:30:31.942005 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:31.943068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:31.953503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:31.954341 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:31.955103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:31.956265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:31.956946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:31.957678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:32.233924 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:32.263050 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b3839722-280d-408e-9aed-22c58ef150cb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1752 microversion: 2.1 time: 0.334210 Aug 29 21:30:32.266951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 242/454] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:31 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1752 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:32.273788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:32.274298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:32.293903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:32.294920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:32.295781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:32.297141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:32.299145 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:32.299145 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:32.520900 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:32.533549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a685b311-e2d9-4fa9-94dd-50408075eb6b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1682 microversion: 2.1 time: 0.265272 Aug 29 21:30:32.534627 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 243/455] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:32 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:32.544289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:32.545452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:32.557811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:32.559377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:32.559959 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:32.561160 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:32.561959 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:32.562685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:32.830903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:32.842420 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:32.843878 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:32.845230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a94f3cf7-9e1f-4e37-b741-a4a4fa6e45fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.309105 Aug 29 21:30:32.845799 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 244/456] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:32 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:33.300324 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:33.301408 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:33.311527 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:33.312365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:33.313107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:33.314316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:33.315105 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:33.315876 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:33.513907 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:33.523032 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ab8f34b5-19d5-4a42-b9f4-811043331f56 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1752 microversion: 2.1 time: 0.229718 Aug 29 21:30:33.523637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 245/457] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:33 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:33.569170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:33.569956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:33.579263 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:33.579982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:33.580491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:33.581361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:33.581866 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:33.582340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:33.736309 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:33.744572 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d19e2b9e-b372-47dc-9229-d4e006c71335 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1682 microversion: 2.1 time: 0.179655 Aug 29 21:30:33.745164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 246/458] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:33 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:33.885154 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:33.886962 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:33.898314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:33.898605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:33.900178 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:33.901052 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:33.901593 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:33.902285 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:34.062536 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:34.072414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:34.073941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:34.075148 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-803a074f-3d3a-4aef-8892-536baf6eecda tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.196778 Aug 29 21:30:34.075731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 247/459] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:33 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:34.545924 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:34.547007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:34.553878 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:34.554315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:34.554755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:34.555677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:34.555963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:34.556421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:34.720904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:34.730030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-397f4452-8463-45e5-a59e-05a9410b18c6 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1752 microversion: 2.1 time: 0.188665 Aug 29 21:30:34.730624 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 248/460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:34 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:34.770168 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:34.770933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:34.778636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:34.779284 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:34.779781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:34.780647 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:34.781120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:34.781587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:34.947947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:34.957898 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-68dd3947-5e99-40a4-8c2f-b487339979da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1682 microversion: 2.1 time: 0.192539 Aug 29 21:30:34.958654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 249/461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:34 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:35.004760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:35.098959 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:35.099571 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:35.106255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:35.106781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:35.107180 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:35.108377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:35.108850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:35.109280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:35.183652 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:35.265544 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:35.282486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:35.287707 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:35.287856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e394253f-b33a-407c-95aa-521db7af4a5c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.192461 Aug 29 21:30:35.288814 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 250/462] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:35 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:35.751574 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:35.752457 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:35.759060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:35.759538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:35.760009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:35.760725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:35.761673 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:35.762091 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:35.948247 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:35.968693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-38c3ecc6-b96d-4d3c-820b-6e6a4297e9fd tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1752 microversion: 2.1 time: 0.220653 Aug 29 21:30:35.969757 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 251/463] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:35 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:35.981723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:35.982351 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:35.989040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:35.989521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:35.989973 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:35.990758 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:35.991227 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:35.991654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:36.148924 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:36.157794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-576f6e7b-6024-430a-a33d-56553bdda766 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1682 microversion: 2.1 time: 0.180408 Aug 29 21:30:36.158433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 252/464] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:35 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:36.311761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:36.312408 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:36.318674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:36.319170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:36.319610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:36.320355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:36.320817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:36.321244 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:36.469119 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b6f21ce1-c066-4bd0-8f74-6dc39c065d73 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.491496 Aug 29 21:30:36.469927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 213/465] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:30:24 2022] POST /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments => generated 194 bytes in 11494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:30:36.508811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:36.530365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:36.536417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:36.541030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ec21afab-ee27-48cd-b96b-47f4672af165 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.232065 Aug 29 21:30:36.542744 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 253/466] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:36 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:36.994532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:36.995286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:37.003845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.004388 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.004835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.005582 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.006279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.006716 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.187956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:37.190239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:37.205747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.206605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.207395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.208995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.209804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.210806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.522632 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:37.534153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-cd9ad969-6d30-42f4-b81f-3e13483c7beb tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1752 microversion: 2.1 time: 0.545930 Aug 29 21:30:37.534766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 214/467] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:36 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1752 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:37.554672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-61a07967-692d-4ea7-8217-310aa33b83bd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:37.563108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-61a07967-692d-4ea7-8217-310aa33b83bd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.563670 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-61a07967-692d-4ea7-8217-310aa33b83bd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.564141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-61a07967-692d-4ea7-8217-310aa33b83bd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.577659 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:37.588853 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-97857d7f-d9ee-4718-863e-b684a9e400ad tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1682 microversion: 2.1 time: 0.408962 Aug 29 21:30:37.595656 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-61a07967-692d-4ea7-8217-310aa33b83bd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Going to try to stop instance {{(pid=121559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:30:37.602645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 254/468] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:37 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1682 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:37.623733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:37.624443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:37.634779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.635292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.636740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.638993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.639245 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.639901 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.871680 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:37.887610 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-61a07967-692d-4ea7-8217-310aa33b83bd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action" status: 202 len: 0 microversion: 2.1 time: 0.337622 Aug 29 21:30:37.888828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 215/469] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:30:37 2022] POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:30:37.906202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:37.911672 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:37.914259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e2e2305c-45a1-47f1-a76a-de0935877ede tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.303963 Aug 29 21:30:37.934313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 255/470] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:37 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:37.936935 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:37.938944 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:37.953929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.954911 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.955662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:37.957513 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:37.958271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:37.960133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:38.195451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:38.205166 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4f22f1d8-ba05-4e3d-b42a-0385c10d127c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.295481 Aug 29 21:30:38.207933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 216/471] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:37 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:38.376091 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-a2efa073-8f89-4e1c-9b24-d3d121ad8ca2 req-f1fa00a1-ac23-44a2-83f9-c265854a5069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28cecc9-0a87-4560-a3de-51196dcc5ad6", "name": "network-vif-deleted", "tag": "3b0e05e5-994d-4858-af60-4b00e1a3aedf"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:38.393602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a2efa073-8f89-4e1c-9b24-d3d121ad8ca2 req-f1fa00a1-ac23-44a2-83f9-c265854a5069 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:38.395167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a2efa073-8f89-4e1c-9b24-d3d121ad8ca2 req-f1fa00a1-ac23-44a2-83f9-c265854a5069 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:38.396197 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a2efa073-8f89-4e1c-9b24-d3d121ad8ca2 req-f1fa00a1-ac23-44a2-83f9-c265854a5069 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:38.413154 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-a2efa073-8f89-4e1c-9b24-d3d121ad8ca2 req-f1fa00a1-ac23-44a2-83f9-c265854a5069 service nova] Creating event network-vif-deleted:3b0e05e5-994d-4858-af60-4b00e1a3aedf for instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 on hv-cinder-85426 Aug 29 21:30:38.423303 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-a2efa073-8f89-4e1c-9b24-d3d121ad8ca2 req-f1fa00a1-ac23-44a2-83f9-c265854a5069 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057220 Aug 29 21:30:38.424614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 256/472] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:30:38.563027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:38.565166 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:38.578317 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:38.578971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:38.579594 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:38.580640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:38.581389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:38.582119 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:38.615398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:38.623593 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:38.631115 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:38.631611 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:38.632151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:38.632859 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:38.633319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:38.633754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:38.777777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:38.781691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:38.788255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-189285ef-5be0-45e2-ab1a-9d1df7438c82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1327 microversion: 2.1 time: 0.176543 Aug 29 21:30:38.807814 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 257/473] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:38 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1327 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:38.871642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:38.881819 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-bb596c52-33a9-448d-be6e-dce85246b88e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.325402 Aug 29 21:30:38.882845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 217/474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:38 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:38.956105 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:38.957098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:38.965827 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:38.966637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:38.967335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:38.968303 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:38.968982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:38.969640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:39.150603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:39.164363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:39.166007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:39.167459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8ec55e49-48de-457c-9196-6d8f8ebb3aef tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.215453 Aug 29 21:30:39.168978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 258/475] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:38 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:39.245401 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:39.246919 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:39.264133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:39.265197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:39.266211 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:39.267616 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:39.268864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:39.269672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:39.480836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:39.502117 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-70ceedcd-55ef-4c16-ba47-bfb602a0632e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.263310 Aug 29 21:30:39.502117 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 218/476] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:39 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:39.817596 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:39.820001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:39.843353 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:39.846006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:39.846006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:39.846442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:39.847152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:39.853216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:39.937076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:39.944332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:40.004481 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:40.021540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:40.022825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:40.024659 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:40.027306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:40.034278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:40.081691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:40.083160 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:40.097347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:40.098459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'fault' on Instance uuid c28cecc9-0a87-4560-a3de-51196dcc5ad6 {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:30:40.245543 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:40.277614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1866f25a-2bef-4c63-ac3d-0bcb269ec6b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 200 len: 1332 microversion: 2.1 time: 0.468706 Aug 29 21:30:40.284837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 259/477] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:39 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 1332 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:40.297614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:40.300933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:40.348730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:40.349870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:40.350676 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:40.358572 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:40.359516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:40.362192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:40.664249 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:40.692389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-793c298e-fb13-425f-b9c3-f275a7e2c820 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.777558 Aug 29 21:30:40.693979 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 219/478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:39 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:40.712459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:40.714507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:40.740655 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:40.745894 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:40.747253 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:40.749799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:40.757075 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:40.760127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:41.024087 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:41.048590 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:41.054915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:41.058722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4d4308e1-def4-47b2-aa8c-f3c251b2b4fb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.770007 Aug 29 21:30:41.062872 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:41.064534 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 260/479] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:40 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:41.075984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e8c76f5a-2bbd-4b2a-b962-188eb6b3170c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.379967 Aug 29 21:30:41.077047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 220/480] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:40 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:41.328688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:41.329573 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:41.338868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:41.340215 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:41.341521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:41.342386 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:41.342957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:41.343489 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:41.364175 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 HTTP/1.1 Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:30:41.365982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:30:41.368104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'c28cecc9-0a87-4560-a3de-51196dcc5ad6'} Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:30:41.369147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:30:41.370712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:30:41.372067 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:30:41.372067 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9b1812aa-949b-4c30-b427-850c3db4430d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 404 len: 111 microversion: 2.1 time: 0.045348 Aug 29 21:30:41.372348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 261/481] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:41 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:30:41.377619 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4d19b12c-7cf5-4c52-9ad0-8673e8249f93 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '.version_select at 0x7fc8401bb8b0>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:41.529211 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4d19b12c-7cf5-4c52-9ad0-8673e8249f93 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070809274" status: 202 len: 0 microversion: 2.1 time: 0.155427 Aug 29 21:30:41.529773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 221/482] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Aug 29 21:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070809274 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:30:41.738494 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:41.740634 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:41.755988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:41.757364 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:41.762910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:41.762910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:41.762910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:41.762910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:42.105994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:42.107469 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:42.120972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:42.124703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:42.125662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:42.128114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:42.130161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:42.130980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:42.244306 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:42.260492 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-aa6844df-bfa1-4ac0-a602-b4cbcdfd7a22 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.531419 Aug 29 21:30:42.264526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 262/483] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:41 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:42.270398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:42.271148 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:42.320689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:42.327635 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:42.328680 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:42.330137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:42.330892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:42.331591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:42.493703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:42.518073 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:42.531690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:42.540464 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e9bdfa46-a811-42ad-8022-8c7cf52af4e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.440371 Aug 29 21:30:42.542602 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 222/484] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:42 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:42.628660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:42.638471 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3d73fe60-75fc-4156-9b4d-9a997e816e41 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.372688 Aug 29 21:30:42.639134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 263/485] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:42 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:43.227443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:43.228436 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:43.239484 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.240318 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.241069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.242259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.243052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.243791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.306434 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:43.308981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:43.323556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.325142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.325350 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.326440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.327303 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.327986 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.501414 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'services' on Instance uuid 979806e6-6c73-40b1-a798-731653815edc {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:30:43.621774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:43.641870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-22445c41-dba7-4ddf-9639-7a913f6b27e5 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.342851 Aug 29 21:30:43.642947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 264/486] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:43 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:43.651096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:43.652698 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:43.663811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.665158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.666207 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.668269 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.669008 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.669693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.928133 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:43.946965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:43.949024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:43.955509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0f4c741c-2b5e-44c5-bfc6-905e165b9ce5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.306948 Aug 29 21:30:43.955509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 265/487] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:43 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:43.963830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:43.964561 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:43.974785 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.975281 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.975746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.976506 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:43.976974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:43.977621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:43.988911 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0016d61b-8fa0-4b65-9e95-af634c498912 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments/8d121139-dcde-49d3-bb97-6dca1ca0ff59" status: 202 len: 0 microversion: 2.1 time: 0.767123 Aug 29 21:30:43.992213 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 223/488] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:30:43 2022] DELETE /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments/8d121139-dcde-49d3-bb97-6dca1ca0ff59 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:30:44.006403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:44.011163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:44.024347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:44.026243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:44.027861 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:44.029621 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:44.030962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:44.032340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:44.088510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-94d52fd5-256a-463a-84e7-26f7325e420a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090766 Aug 29 21:30:44.089923 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 224/489] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:30:43 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:30:44.208411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:44.218925 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-df38dcbb-50d4-40ad-8563-32d6b874045b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.265957 Aug 29 21:30:44.219611 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 266/490] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:43 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:44.666652 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:44.668170 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:44.675427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:44.676115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:44.676693 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:44.678778 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:44.679668 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:44.680559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:44.888232 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:44.901018 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-512e9e31-b84a-452e-a1d3-514eab985333 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.238103 Aug 29 21:30:44.906540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 225/491] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:44 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:45.006672 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:45.007825 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:45.021124 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.021946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.022997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.024310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.027044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.028153 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.104015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:45.107124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:45.117941 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.119154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.122469 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.123796 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.124873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.125493 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.179613 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-722493a5-5b9c-43b0-98eb-73a616693746 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080189 Aug 29 21:30:45.180743 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 226/492] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:30:45 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:30:45.185645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-a5ab1f77-7abc-4327-a47b-e83d829292ea req-d48783be-7b6e-42b7-a734-83683fe6ac75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9c011-918f-4702-83d6-cd5fd83a1a3a", "name": "network-vif-plugged", "status": "completed", "tag": "7d00a0ed-45ea-43c9-98bc-7122049be3a0"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:45.196965 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-a5ab1f77-7abc-4327-a47b-e83d829292ea req-d48783be-7b6e-42b7-a734-83683fe6ac75 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.197589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-a5ab1f77-7abc-4327-a47b-e83d829292ea req-d48783be-7b6e-42b7-a734-83683fe6ac75 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.198036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-a5ab1f77-7abc-4327-a47b-e83d829292ea req-d48783be-7b6e-42b7-a734-83683fe6ac75 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.216127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-a5ab1f77-7abc-4327-a47b-e83d829292ea req-d48783be-7b6e-42b7-a734-83683fe6ac75 service nova] Creating event network-vif-plugged:7d00a0ed-45ea-43c9-98bc-7122049be3a0 for instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a on hv-cinder-85426 Aug 29 21:30:45.226052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-a5ab1f77-7abc-4327-a47b-e83d829292ea req-d48783be-7b6e-42b7-a734-83683fe6ac75 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043532 Aug 29 21:30:45.227469 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 227/493] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:30:45.248679 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:45.281564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:45.281983 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:45.282195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.282195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.282195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.282195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.282811 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.282811 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.283099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:45.283099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:45.283099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6343a54b-1fc3-4b01-8182-efeac1560ecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.277953 Aug 29 21:30:45.283550 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 267/494] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:44 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:45.489126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:45.502178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-04492862-19ff-4084-9ceb-75bd68c42151 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.261427 Aug 29 21:30:45.503385 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 228/495] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:45 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:45.819641 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:45.822765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:45.830819 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.836237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.836237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.836237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.836237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.836860 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.862286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'flavor' on Instance uuid 47361729-1df7-4084-8819-76e4b8e43a1e {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:30:45.947102 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:45.951079 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:45.958016 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.958710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.959307 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.960555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:45.961150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:45.961792 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:45.971606 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:46.227492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:46.243047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-224a8068-2b95-4ef7-915c-073d61500df1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.301277 Aug 29 21:30:46.244195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 229/496] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:45 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:46.252672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:46.256321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:46.266564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.267961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.272994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.272994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.273461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.274461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.318919 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1be05621-895b-4ce4-ac47-d61aeb4d4646 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073238 Aug 29 21:30:46.324269 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 230/497] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:30:46 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:30:46.329930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:46.330685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:46.337921 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.345931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.345931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.345931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.345931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.346994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.580213 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:46.595454 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:46.597729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:46.599872 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-29b3065d-9396-4299-8200-cc9010a5d02a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.274125 Aug 29 21:30:46.601574 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 231/498] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:46 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:46.605481 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ee08e353-21e0-4d75-81f0-a9d03a644a6a tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/action" status: 200 len: 32 microversion: 2.1 time: 0.789756 Aug 29 21:30:46.608604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 268/499] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:30:45 2022] POST /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/action => generated 32 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:30:46.613357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:46.614936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:46.623327 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:46.624219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:46.627595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.628515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.629278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.631064 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.631462 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.631858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.632056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.632508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.632643 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.633163 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:46.634219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:46.634219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:46.868803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:46.885608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:46.894394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-822b1d08-0163-4722-9fd7-51cda8f0d351 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.278301 Aug 29 21:30:46.896717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 269/500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:46 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:46.913478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9175ef9d-e104-4a93-90fa-eb3feac07015 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.309753 Aug 29 21:30:46.916498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 232/501] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:46 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:47.272776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:47.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:47.291291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.292216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.293292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:47.294342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.295018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.295542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:47.342809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:47.348147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:47.363182 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.364519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.365168 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:47.366069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.366644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.367229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:47.416053 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5ab8ea81-04ff-424c-a60b-1fb28824c77a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085365 Aug 29 21:30:47.418629 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 233/502] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:30:47 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:30:47.538028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:47.538674 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:47.551330 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.554187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.554720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:47.559395 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.560690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.561934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:47.602027 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:30:47.647976 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:47.660482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-277bd2e9-20a5-495e-848b-1aed42eeae68 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.390528 Aug 29 21:30:47.661329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 270/503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:47 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:47.666701 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:47.667710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:47.676013 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.679186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.679186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:47.679186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:47.679186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:47.679774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.124476 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e1bd11b5-8dfd-4e8b-b9d1-b0c72744407a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 204 len: 0 microversion: 2.1 time: 0.592438 Aug 29 21:30:48.127938 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 234/504] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:30:47 2022] DELETE /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:30:48.139792 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:48.140855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:48.154000 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.155342 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.156409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.157886 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.158953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.159711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.197402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:48.219188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:48.223322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:48.225873 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5f58a0ab-8271-4464-8573-f370f3a526cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.563259 Aug 29 21:30:48.240352 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 271/505] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:47 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:48.256578 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:48.258930 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:48.275654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.277134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.277935 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.279170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.280286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.280866 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.441856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:48.461440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5f21a5d6-3640-4d41-b623-68b416df9068 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.331452 Aug 29 21:30:48.461440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 235/506] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:48 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:48.469671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:48.470700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:48.485842 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.486636 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.487384 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.488256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.489082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.489509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.615056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:48.618883 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:48.632737 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2f8d8d0c-e9e3-42be-b06e-359b256b8ef5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1676 microversion: 2.1 time: 0.390080 Aug 29 21:30:48.635617 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 272/507] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:48 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1676 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:48.686449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:48.688729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:48.697107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.698008 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.704302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.704302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:48.704302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:48.704302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:48.733325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:48.751215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2fefc942-ebf3-4627-acf3-82774b7cb2e4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1682 microversion: 2.1 time: 0.288803 Aug 29 21:30:48.751999 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 236/508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:48 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1682 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:48.955849 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:48.971408 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-165a35fa-2c45-4554-bd72-80de1841d56d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.291085 Aug 29 21:30:48.977708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 273/509] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:48 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:49.268771 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:49.269373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:49.277841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.278391 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.278894 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.279765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.280358 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.280798 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.483723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:49.488602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:49.490271 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:49.497328 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.498170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.500996 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.501998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.502597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.503130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.505036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:49.506956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:49.508364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c517097a-df9a-4d94-b0c2-e16a53e7aa77 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.244058 Aug 29 21:30:49.520159 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 237/510] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:49 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:49.675234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:49.676189 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:49.681598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:49.693097 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.693588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.694230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0fb8d34d-880e-4041-bbda-bd38b3105689 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.212596 Aug 29 21:30:49.694926 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.695078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 274/511] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:49 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:49.695222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.695485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.695934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.776339 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:49.776339 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:49.784913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.786969 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.786969 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.787432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.788042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.788490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:49.916584 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:49.929625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-339c590a-5758-41c5-bf47-729eebdcb424 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1653 microversion: 2.1 time: 0.262173 Aug 29 21:30:49.929918 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 238/512] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:49 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1653 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:49.953779 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c9439dc5-afc9-4dcf-963c-749c8a6d4e58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:49.964130 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9439dc5-afc9-4dcf-963c-749c8a6d4e58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:49.964916 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9439dc5-afc9-4dcf-963c-749c8a6d4e58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:49.965352 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9439dc5-afc9-4dcf-963c-749c8a6d4e58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.015378 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c9439dc5-afc9-4dcf-963c-749c8a6d4e58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Going to try to start instance {{(pid=121559) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:30:50.032674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:50.042755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a1c689ad-39f3-414c-b826-efaafb4d5048 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1682 microversion: 2.1 time: 0.271042 Aug 29 21:30:50.051957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 275/513] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:49 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1682 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:50.051957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:50.051957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:50.063183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.063967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.064543 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.065706 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.066332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.066877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.273384 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c9439dc5-afc9-4dcf-963c-749c8a6d4e58 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action" status: 202 len: 0 microversion: 2.1 time: 0.324359 Aug 29 21:30:50.274850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 239/514] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:30:49 2022] POST /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:30:50.286273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:50.288514 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:50.298720 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.300535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.301639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.303295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.304589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.306010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.346401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:50.364717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8cb2e851-7189-4277-ab62-eba0a89e5a9d tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.319061 Aug 29 21:30:50.379590 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 276/515] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:50 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:50.539832 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:50.556904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:50.559279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:50.584226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-215c95f4-d59e-426e-9325-e308d8f5d097 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1662 microversion: 2.1 time: 0.303213 Aug 29 21:30:50.588548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:50.592759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.594001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.594292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.595366 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.596031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.596664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 240/516] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:50 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1662 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:50.597669 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.730327 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:50.731404 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:50.749034 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.749797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.750407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.751753 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:50.757903 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:50.758708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:50.993089 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:51.008129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:51.010521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:51.012736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a9155849-cd22-462b-9cfe-0bf464a981ad tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1809 microversion: 2.20 time: 0.468114 Aug 29 21:30:51.013749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 277/517] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:50 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1809 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:30:51.078781 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:51.079698 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:51.081079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:51.093458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:51.094212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:51.094845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:51.096354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:51.097734 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:51.098476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:51.112064 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-11f5ed89-6640-4dd8-80aa-1752ec2de360 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.386953 Aug 29 21:30:51.115153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 241/518] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:50 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:51.348224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:51.375431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f2784dca-21a5-49be-8a2f-ee42140181ec tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1682 microversion: 2.1 time: 0.306943 Aug 29 21:30:51.377134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 278/519] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:51 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1682 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:51.394782 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:51.395572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:51.411512 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:51.412589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:51.413682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:51.415063 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:51.416083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:51.417489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:51.632093 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:51.633269 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:51.644967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:51.645663 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:51.646535 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:51.647989 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:51.649291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:51.650033 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:51.881482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:51.900483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d42d8c7c-f1d5-4f36-9047-0371fedf4a26 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1662 microversion: 2.1 time: 0.284579 Aug 29 21:30:51.901608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 279/520] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:51 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1662 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:52.030822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:52.051972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-90b7f750-26e3-48b5-8731-e87831d0e7a8 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.661439 Aug 29 21:30:52.053760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 242/521] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:51 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:52.056856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:52.058880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:52.070472 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.071327 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.072205 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:52.073532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.074442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.075424 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:52.164173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:52.166227 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:52.182313 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.184403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.185830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:52.187526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.188756 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.189858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:52.214214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:52.456487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:52.476932 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:52.481186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:52.485444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f7dfdb6c-966d-40bf-9728-a4fb41e22f0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1796 microversion: 2.20 time: 0.439299 Aug 29 21:30:52.487246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 280/522] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:30:52 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1796 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:30:52.496857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:52.498213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:52.510956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.514964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.514964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:52.514964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.516703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.516894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:52.815145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:52.821592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:52.834618 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c91dc06a-1fcf-45e7-97d9-0a76238e576e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.680203 Aug 29 21:30:52.836396 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 243/523] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:52 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:52.871305 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c404fec5-7362-4672-a512-366f0ae82e36 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1682 microversion: 2.1 time: 0.382066 Aug 29 21:30:52.874486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 281/524] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:52 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1682 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:52.942734 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:52.943850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:52.956398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.957250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.959710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:52.961566 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:52.962622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:52.963646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:53.091239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:53.093024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:53.103534 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:53.104478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:53.105200 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:53.106409 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:53.107583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:53.108502 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:53.234840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:53.248478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0d366b54-0ca3-473e-9fe4-d69f5c45fea6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1662 microversion: 2.1 time: 0.312914 Aug 29 21:30:53.250178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 244/525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:52 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1662 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:53.393295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:53.408209 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9b7104b6-40b2-4256-96a4-5f37a023742f tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.319241 Aug 29 21:30:53.420873 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 282/526] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:53 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:53.881324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:53.881324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:53.917817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:53.918792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:53.924661 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:53.925399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:53.933137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:53.933137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:53.933137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:53.933137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:53.944764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:53.947667 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:53.948947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:53.957414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:53.968367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:53.974841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:54.173376 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:54.216261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bfa21611-98e6-4ad8-b6da-f6d587d93bc7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1614 microversion: 2.1 time: 0.303117 Aug 29 21:30:54.217999 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 283/527] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:53 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1614 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:54.237578 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-f8ad1949-8043-4d19-ada7-b624bab9a903 req-d6b923a3-0f52-4c25-89dd-5e4bc9f9a714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979806e6-6c73-40b1-a798-731653815edc", "name": "network-vif-deleted", "tag": "32eade43-2044-402f-ab19-8fcb425b1b8a"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:54.268934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f8ad1949-8043-4d19-ada7-b624bab9a903 req-d6b923a3-0f52-4c25-89dd-5e4bc9f9a714 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:54.269768 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f8ad1949-8043-4d19-ada7-b624bab9a903 req-d6b923a3-0f52-4c25-89dd-5e4bc9f9a714 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:54.270776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f8ad1949-8043-4d19-ada7-b624bab9a903 req-d6b923a3-0f52-4c25-89dd-5e4bc9f9a714 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:54.299390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-f8ad1949-8043-4d19-ada7-b624bab9a903 req-d6b923a3-0f52-4c25-89dd-5e4bc9f9a714 service nova] Creating event network-vif-deleted:32eade43-2044-402f-ab19-8fcb425b1b8a for instance 979806e6-6c73-40b1-a798-731653815edc on hv-cinder-85426 Aug 29 21:30:54.310004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-f8ad1949-8043-4d19-ada7-b624bab9a903 req-d6b923a3-0f52-4c25-89dd-5e4bc9f9a714 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089270 Aug 29 21:30:54.311444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 284/528] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:30:54.323354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:54.328874 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:54.335342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:54.335949 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:54.336756 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:54.338238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:54.339412 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:54.341231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:54.504082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:54.561345 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-90670ad7-db7f-4840-84b4-e590fd3ae91d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.692973 Aug 29 21:30:54.563239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 245/529] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:53 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:54.574253 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:54.575764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:54.614980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:54.615822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:54.617412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:54.619678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:54.619678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:54.621316 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:54.705822 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:54.723481 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9ead0755-bea9-45fa-918b-48b65b8048b6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1666 microversion: 2.1 time: 0.409752 Aug 29 21:30:54.725694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 285/530] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:54 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1666 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:54.966910 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:55.002840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3ddf1c0b-65a6-4c0e-a456-246660cb1047 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1757 microversion: 2.1 time: 0.437212 Aug 29 21:30:55.004864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 246/531] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:54 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1757 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:55.258208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:55.258208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:55.268027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:55.268027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:55.273915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:55.273915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:55.273915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:55.273915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:55.320246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:55.320971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:55.321734 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:55.322407 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'fault' on Instance uuid 979806e6-6c73-40b1-a798-731653815edc {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:30:55.403497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:55.425983 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1edac00f-580e-468a-a698-e45380c12cd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1330 microversion: 2.1 time: 0.172844 Aug 29 21:30:55.427692 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 286/532] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:55 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:55.611097 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:55.612238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:55.624975 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:55.625830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:55.626579 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:55.628369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:55.629151 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:55.629859 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:55.852018 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:55.867426 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0fde0245-8b7e-48f9-9ce6-640bb4918165 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.265795 Aug 29 21:30:55.868496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 247/533] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:55 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:56.039935 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:56.041072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:56.055958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:56.055958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:56.055958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:56.055958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:56.056411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:56.057154 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:56.259173 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:56.270457 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d04d14db-1d77-4cf2-a844-fa577b68d338 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1760 microversion: 2.1 time: 0.242248 Aug 29 21:30:56.272279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 287/534] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:56 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1760 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:30:56.466714 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:56.467695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:56.477312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:56.477998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:56.478590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:56.480179 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:56.480791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:56.481574 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:56.523952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:56.524343 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:56.524870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:56.525333 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'fault' on Instance uuid 979806e6-6c73-40b1-a798-731653815edc {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:30:56.587637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:56.601790 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8d41a87f-ade2-4454-b4e2-c4252896b530 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 200 len: 1330 microversion: 2.1 time: 0.139764 Aug 29 21:30:56.602830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 248/535] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:56 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 1330 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:56.903754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:56.904389 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:56.910489 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:56.910967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:56.911397 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:56.912122 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:56.912569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:56.912988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:57.060112 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:57.069784 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bc27c184-34c8-4562-910b-cfe66b5c0764 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.169978 Aug 29 21:30:57.070382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 288/536] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:56 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:57.628776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:57.629776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:57.637917 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:57.638319 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:57.638753 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:57.639468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:57.639955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:57.640383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:57.658140 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc HTTP/1.1 Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:30:57.659821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:30:57.661936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '979806e6-6c73-40b1-a798-731653815edc'} Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:30:57.663764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:30:57.666406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:30:57.669146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:30:57.669146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2143702a-d700-4621-bf35-6f21440cf586 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 404 len: 111 microversion: 2.1 time: 0.039793 Aug 29 21:30:57.669146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 249/537] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:57 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:30:57.671847 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1b10c251-7d9f-4265-8e09-c02f035b93a1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '.version_select at 0x7fc8401930d0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:57.779767 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1b10c251-7d9f-4265-8e09-c02f035b93a1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305031631" status: 202 len: 0 microversion: 2.1 time: 0.111523 Aug 29 21:30:57.780436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 289/538] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Aug 29 21:30:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305031631 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:30:58.092523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:58.093479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:58.099924 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:58.100435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:58.100870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:58.101569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:58.102025 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:58.102442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:58.249127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:58.260051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-36eb98a5-016a-470d-b8f5-26777d09730d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.171692 Aug 29 21:30:58.260808 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 250/539] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:58 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:30:58.699776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d3022a59-370b-46cf-8a57-a014e0d13ad7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: .version_select at 0x7fc840162a60>, body: {"keypair": {"name": "tempest-keypair-1898889167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWSvGu/NGXaEkn+4XssiMLSoirTrwWErYurC39xNf59zFQ2UygS3fd/mVR6A67RMiJbGJJdLNvvhiNji5+kO9yz4PXWzJFMdbfO+/08zLC5kjxdABtjg6MQaIWAbmkolw=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:30:58.718132 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-d3022a59-370b-46cf-8a57-a014e0d13ad7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:30:58.722410 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-d3022a59-370b-46cf-8a57-a014e0d13ad7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:30:58.871151 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d3022a59-370b-46cf-8a57-a014e0d13ad7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177213 Aug 29 21:30:58.871755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 290/540] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:30:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:30:59.282711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:30:59.283343 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:30:59.291405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:59.292112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:59.294328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:59.294328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:30:59.294328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:30:59.294328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:30:59.440562 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:30:59.449742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f559dfb5-bba3-4aff-9eff-6c4f6b68a8d0 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.170329 Aug 29 21:30:59.450556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 251/541] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:30:59 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:00.474250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:00.474250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:00.478564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:00.479060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:00.479592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:00.480393 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:00.480783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:00.481206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:00.728034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:00.732829 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:00.739721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a96eabb3-1312-4950-bb33-ec4bbfd3abc2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.272411 Aug 29 21:31:00.740354 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 291/542] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:00 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:01.766409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:01.767664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:01.779445 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:01.780341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:01.781121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:01.782293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:01.783113 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:01.783867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:01.855825 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176532905", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d52e082-ed9a-4937-bc0b-8b03e2527c03"}], "security_groups": [{"name": "tempest-securitygroup--1418823434"}], "key_name": "tempest-keypair-1898889167", "user_data": "}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:01.977608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:01.993254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e54e2790-522a-4dba-9018-7d964b7e32be tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.233728 Aug 29 21:31:01.994336 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 252/543] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:01 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:02.004439 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.network.neutron [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] validate_networks() for [('5d52e082-ed9a-4937-bc0b-8b03e2527c03', None, None, None, None, None)] {{(pid=121558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:31:02.715617 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:31:02.716464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:31:02.717068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:31:02.717572 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:31:02.718230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:31:02.729416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:02.729923 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:02.730368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:02.737205 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:02.737784 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:02.738241 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:02.759787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:31:02.765524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:31:02.779374 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Going to run 1 instances... {{(pid=121558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:31:02.781823 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:31:02.924507 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0b635a9a-785e-4f2e-aa13-41e37aa8a4fd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.074465 Aug 29 21:31:02.925947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 292/544] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:31:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:31:02.939305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1dfc4a0d-2d17-48d7-aa5c-3c762aa2dcd1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:02.940665 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1dfc4a0d-2d17-48d7-aa5c-3c762aa2dcd1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:03.009020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1dfc4a0d-2d17-48d7-aa5c-3c762aa2dcd1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:03.024986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1dfc4a0d-2d17-48d7-aa5c-3c762aa2dcd1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1241 microversion: 2.1 time: 0.089724 Aug 29 21:31:03.028085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 253/545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:02 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:03.029894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:03.030581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:03.048584 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:03.049616 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:03.050321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:03.051684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:03.052935 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:03.054740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:03.215278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:03.226309 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d94224d8-21d7-4e64-bf82-b102acf4b3cb tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.201674 Aug 29 21:31:03.226935 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 293/546] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:03 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:04.049222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-41e0257e-8d65-46d0-87da-6180ca7dd622 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:04.050042 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-41e0257e-8d65-46d0-87da-6180ca7dd622 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:04.115554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-41e0257e-8d65-46d0-87da-6180ca7dd622 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:04.127379 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-41e0257e-8d65-46d0-87da-6180ca7dd622 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1241 microversion: 2.1 time: 0.082046 Aug 29 21:31:04.128300 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 254/547] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:04 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:04.249551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:04.250360 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:04.257530 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:04.258019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:04.258452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:04.259170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:04.259625 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:04.260164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:04.429646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:04.439414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9eb0bdcb-4de6-4f5b-b049-7df62f4f6d9d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.194830 Aug 29 21:31:04.440039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 294/548] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:04 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:05.162074 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:05.162990 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:05.165082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:05.173559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:05.174109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:05.174545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:05.175264 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:05.175717 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:05.176170 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:05.245685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:05.256647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dd6294e8-9fe4-4116-a2e1-1c45622466ca tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1293 microversion: 2.1 time: 0.098537 Aug 29 21:31:05.257248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 255/549] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:05 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:05.463332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:05.464787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:05.473126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:05.474502 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:05.474502 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:05.474502 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:05.475314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:05.475314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:05.656951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:05.666126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9085de70-3cb0-434f-ab27-b419925e155e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.207237 Aug 29 21:31:05.667348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 295/550] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:05 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:06.284928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:06.285643 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:06.293613 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:06.294313 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:06.294833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:06.295672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:06.296231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:06.296724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:06.422278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:06.435085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4b04811b-4d93-45d9-a2f8-42ee111b0597 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1301 microversion: 2.1 time: 0.154335 Aug 29 21:31:06.447452 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 256/551] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:06 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1301 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:06.694285 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:06.695205 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:06.709446 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:06.710335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:06.711135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:06.712557 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:06.713959 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:06.714781 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:06.910957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:06.929376 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8c8b4ac1-2bfb-46ea-a9fb-a73e3a8b761c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.238152 Aug 29 21:31:06.929376 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 296/552] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:06 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:07.472783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:07.474082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:07.483822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:07.489141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:07.489141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:07.489141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:07.489141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:07.489587 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:07.760845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:07.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-95286a67-34e4-42c3-81e2-d2d34871270c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1367 microversion: 2.1 time: 0.304976 Aug 29 21:31:07.774620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 257/553] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:07 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:07.960261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:07.961230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:07.968834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:07.969373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:07.969755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:07.970461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:07.970910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:07.971333 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:08.178230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:08.188262 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2fc0b1bd-1f8a-46e8-9974-5d4de6d0d770 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.232828 Aug 29 21:31:08.188886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 297/554] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:07 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:08.477177 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-d24c6cea-8f3b-4150-bbd7-d48ba02fbeb9 req-08e0b593-b698-482e-ba5b-21132468ad43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8776b21b-316e-4438-a12f-ee8aef1a85e4", "tag": "b44a2d3f-af24-48dd-823e-bdbfd82ce7a3"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:08.494518 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d24c6cea-8f3b-4150-bbd7-d48ba02fbeb9 req-08e0b593-b698-482e-ba5b-21132468ad43 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:08.495136 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d24c6cea-8f3b-4150-bbd7-d48ba02fbeb9 req-08e0b593-b698-482e-ba5b-21132468ad43 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:08.495672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d24c6cea-8f3b-4150-bbd7-d48ba02fbeb9 req-08e0b593-b698-482e-ba5b-21132468ad43 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:08.512797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-d24c6cea-8f3b-4150-bbd7-d48ba02fbeb9 req-08e0b593-b698-482e-ba5b-21132468ad43 service nova] Creating event network-changed:b44a2d3f-af24-48dd-823e-bdbfd82ce7a3 for instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 on hv-cinder-85426 Aug 29 21:31:08.521060 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-d24c6cea-8f3b-4150-bbd7-d48ba02fbeb9 req-08e0b593-b698-482e-ba5b-21132468ad43 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049020 Aug 29 21:31:08.522378 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 258/555] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:08.797812 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:08.802774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:08.805710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:08.806208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:08.806645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:08.807916 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:08.808378 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:08.808851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:08.984215 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:09.000395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-933a63c0-eb19-48ae-87fb-5dd8894e3528 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1367 microversion: 2.1 time: 0.205766 Aug 29 21:31:09.001432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 298/556] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:08 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:09.211742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:09.212530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:09.222271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:09.223201 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:09.224042 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:09.225335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:09.226091 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:09.226707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:09.529206 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:09.546432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-900d5057-637e-4e7d-a4b0-1217b8ece430 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.338622 Aug 29 21:31:09.547537 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 259/557] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:09 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:10.024668 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:10.025347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:10.036629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:10.037508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:10.038298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:10.039582 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:10.040420 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:10.041198 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:10.215512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:10.237684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6b336525-102d-4556-9c4b-15ffff4dd920 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1367 microversion: 2.1 time: 0.216548 Aug 29 21:31:10.238702 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 299/558] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:10 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:10.580141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:10.580911 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:10.588231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:10.588721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:10.589159 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:10.589880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:10.590337 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:10.590762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:10.800145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:10.815947 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-31d48568-1614-4e05-b4ae-77a3fc17e372 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.239813 Aug 29 21:31:10.817009 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 260/559] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:10 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:11.265410 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:11.266505 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:11.278308 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:11.279174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:11.279773 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:11.280704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:11.281270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:11.281911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:11.477622 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:11.486256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2db64493-fbd2-4a0a-acf7-465655cac81e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1367 microversion: 2.1 time: 0.229239 Aug 29 21:31:11.486875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 300/560] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:11 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:11.846139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:11.847644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:11.854603 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:11.855190 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:11.855665 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:11.856435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:11.856898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:11.857328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:12.008285 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:12.017382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2a27c178-9b55-4e4d-94d8-592b96c87b21 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.175287 Aug 29 21:31:12.017977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 261/561] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:11 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:12.514837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:12.514837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:12.527292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:12.532868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:12.532868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:12.532868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:12.532868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:12.533508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:12.715733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:12.725100 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e7c70507-8c75-484a-a26f-8c7d3f8470a6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1367 microversion: 2.1 time: 0.218744 Aug 29 21:31:12.727655 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 301/562] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:12 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:13.053385 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:13.054798 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:13.064881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:13.065372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:13.065811 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:13.066524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:13.066976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:13.067395 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:13.233112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:13.238171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:13.245415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-19dd4459-d433-4872-affd-15337ef806e3 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.196729 Aug 29 21:31:13.246283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 262/563] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:13 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:13.312998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-e2754cc6-003f-4dd8-8cf3-20615677bbb3 req-1f5719c1-1118-45be-b376-a2e8e1ebba2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8776b21b-316e-4438-a12f-ee8aef1a85e4", "name": "network-vif-plugged", "status": "completed", "tag": "b44a2d3f-af24-48dd-823e-bdbfd82ce7a3"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:13.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:13.324817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=10 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:13.325819 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-e2754cc6-003f-4dd8-8cf3-20615677bbb3 req-1f5719c1-1118-45be-b376-a2e8e1ebba2d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:13.326286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-e2754cc6-003f-4dd8-8cf3-20615677bbb3 req-1f5719c1-1118-45be-b376-a2e8e1ebba2d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:13.326718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-e2754cc6-003f-4dd8-8cf3-20615677bbb3 req-1f5719c1-1118-45be-b376-a2e8e1ebba2d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:13.338650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-e2754cc6-003f-4dd8-8cf3-20615677bbb3 req-1f5719c1-1118-45be-b376-a2e8e1ebba2d service nova] Creating event network-vif-plugged:b44a2d3f-af24-48dd-823e-bdbfd82ce7a3 for instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 on hv-cinder-85426 Aug 29 21:31:13.344275 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-e2754cc6-003f-4dd8-8cf3-20615677bbb3 req-1f5719c1-1118-45be-b376-a2e8e1ebba2d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035688 Aug 29 21:31:13.344884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 302/564] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:13.759118 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:13.759636 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:13.768708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:13.769588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:13.770357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:13.771625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:13.772517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:13.773292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:13.922127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:13.930373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b32028df-ba6a-4592-bbf7-3e8c2845f9ef tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1367 microversion: 2.1 time: 0.175240 Aug 29 21:31:13.930952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 263/565] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:13 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:14.275257 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:14.276609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:14.289610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:14.290493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:14.291225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:14.292540 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:14.293335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:14.294103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:14.473702 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:14.483766 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-be64d50f-b5bf-40e6-a2ef-d219a7dcbe9c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1731 microversion: 2.1 time: 0.218292 Aug 29 21:31:14.486694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 303/566] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:14 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:14.952611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:14.953273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:14.955669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=4 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:14.961181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:14.961763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:14.962318 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:14.963833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:14.964382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:14.964929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:15.122230 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:15.134504 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1c09671a-e147-4344-87d8-141257f2fe2b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1367 microversion: 2.1 time: 0.185777 Aug 29 21:31:15.136104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 264/567] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:14 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:15.508871 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:15.511069 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:15.522167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:15.525009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:15.525009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:15.525346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:15.526551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:15.527310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:15.717819 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:15.731569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d336d9fb-a259-4446-b2a2-c1defed25050 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1711 microversion: 2.1 time: 0.228951 Aug 29 21:31:15.732110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 304/568] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:15 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1711 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:15.910824 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:15.911689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:15.919857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:15.920382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:15.920828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:15.921549 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:15.921998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:15.922423 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.029554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] HTTP exception thrown: Cannot 'detach_volume' instance 47361729-1df7-4084-8819-76e4b8e43a1e while it is in vm_state rescued Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Request method failure captured: Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments/0340c9de-ec52-437f-9554-10c816aab59e HTTP/1.1 Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VAKorWYiJaDKSSEZ11WWrQkfPVT8wxHn8T26g1yqqzyhW2JAhbu3_S1nxRmQ70ZuZqG6_BrQzX1ADV05SpV9EossnjrkiMPSBPoBmlFlWw93_0pmdc0oyC_0MObKokOavxNqNayYYo0Dos-E2Ev9T2uk4K-q6UuZQm-wM7864QaQ Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:31:16.031263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd7bb76694c2499895f24e611c644a27", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: b7e0a78238e94fa4a8209550c901a9a5 Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:31:16.034099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Cannot 'detach_volume' instance 47361729-1df7-4084-8819-76e4b8e43a1e while it is in vm_state rescued Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'server_id': '47361729-1df7-4084-8819-76e4b8e43a1e', 'id': '0340c9de-ec52-437f-9554-10c816aab59e'} Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47361729-1df7-4084-8819-76e4b8e43a1e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:31:16.035630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 47361729-1df7-4084-8819-76e4b8e43a1e while it is in vm_state rescued Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 47361729-1df7-4084-8819-76e4b8e43a1e while it is in vm_state rescued Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:16.038963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Returning 409 to user: Cannot 'detach_volume' instance 47361729-1df7-4084-8819-76e4b8e43a1e while it is in vm_state rescued {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:31:16.042139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-97c0f121-793c-49dd-a792-1cac58b91838 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "DELETE /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments/0340c9de-ec52-437f-9554-10c816aab59e" status: 409 len: 152 microversion: 2.1 time: 0.129476 Aug 29 21:31:16.042139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 265/569] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:31:15 2022] DELETE /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments/0340c9de-ec52-437f-9554-10c816aab59e => generated 152 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:31:16.042810 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:16.043351 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:16.049887 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.050377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.050815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.051727 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.052383 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.052854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.169546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:16.170153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:16.177621 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.178108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.178535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.179239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.179754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.180233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.302254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-386dc9aa-ceb5-4cc7-a4f3-5ca3862de4f2 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "POST /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/action" status: 202 len: 0 microversion: 2.1 time: 0.263363 Aug 29 21:31:16.303282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 305/570] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:31:16 2022] POST /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:31:16.318787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:16.320096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:16.331521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.332981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.333173 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.334474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.335260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.336105 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.392432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:16.403527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-db0d843c-6589-4678-aff9-e08ba32647ac tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1558 microversion: 2.1 time: 0.238119 Aug 29 21:31:16.404417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 266/571] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:16 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:16.432519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:16.433316 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:16.450268 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.451338 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.452489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.455205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:16.457158 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:16.458903 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:16.577495 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:16.587265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fc32d3ef-4067-4488-8685-d86ebd940d94 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1719 microversion: 2.1 time: 0.276519 Aug 29 21:31:16.588645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 306/572] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:16 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1719 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:16.601221 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c7531b4a-c3ec-40f2-b1d5-733bd36e05f0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177811 Aug 29 21:31:16.602287 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 267/573] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:31:16 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:17.624140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:17.625003 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:17.632422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:17.632996 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:17.633681 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:17.634418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:17.634966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:17.635384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:18.158607 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:18.174344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bb37e807-221f-4d0a-922e-eecb7d4857df tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1719 microversion: 2.1 time: 0.555005 Aug 29 21:31:18.175473 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 307/574] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:17 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1719 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:18.346476 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-bc3bc350-dcf0-430f-a42c-8f50934193e2 req-b10ebf09-9786-446d-925d-157e2ce03c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8776b21b-316e-4438-a12f-ee8aef1a85e4", "tag": "b44a2d3f-af24-48dd-823e-bdbfd82ce7a3"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:18.359085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-bc3bc350-dcf0-430f-a42c-8f50934193e2 req-b10ebf09-9786-446d-925d-157e2ce03c16 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:18.359965 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-bc3bc350-dcf0-430f-a42c-8f50934193e2 req-b10ebf09-9786-446d-925d-157e2ce03c16 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:18.361114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-bc3bc350-dcf0-430f-a42c-8f50934193e2 req-b10ebf09-9786-446d-925d-157e2ce03c16 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:18.375785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-bc3bc350-dcf0-430f-a42c-8f50934193e2 req-b10ebf09-9786-446d-925d-157e2ce03c16 service nova] Creating event network-changed:b44a2d3f-af24-48dd-823e-bdbfd82ce7a3 for instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 on hv-cinder-85426 Aug 29 21:31:18.382277 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-bc3bc350-dcf0-430f-a42c-8f50934193e2 req-b10ebf09-9786-446d-925d-157e2ce03c16 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040005 Aug 29 21:31:18.382896 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 268/575] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:19.215465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:19.218029 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:19.231382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:19.232625 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:19.233484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:19.234645 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:19.235471 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:19.236275 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:19.434539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:19.442024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:19.457231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e6c12aeb-03e5-4ad4-ba70-6e01a74dd219 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1719 microversion: 2.1 time: 0.249820 Aug 29 21:31:19.458232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 308/576] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:19 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1719 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:20.484312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:20.485049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:20.493312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:20.493803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:20.494267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:20.495599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:20.496114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:20.496548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:20.785980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:20.801640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-66be4d16-5242-468c-b27e-81b13a166692 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1725 microversion: 2.1 time: 0.322683 Aug 29 21:31:20.802639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 269/577] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:20 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:20.839774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:20.840661 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:20.846702 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:20.856070 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:20.857034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:20.857397 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:20.858252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:20.858830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:20.859379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:20.961997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f9478ef5-8331-47ac-8241-8589a1b38322 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129693 Aug 29 21:31:20.964143 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 309/578] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:31:20 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:22.257474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-03d724ca-315d-4449-8039-03dfc1b62584 req-0afae509-4c46-4d0f-9fbf-6b349c1501ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47361729-1df7-4084-8819-76e4b8e43a1e", "tag": "81cd5932-3a95-43b6-86ae-902a62b744b9"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:22.274815 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-03d724ca-315d-4449-8039-03dfc1b62584 req-0afae509-4c46-4d0f-9fbf-6b349c1501ce service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:22.276186 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-03d724ca-315d-4449-8039-03dfc1b62584 req-0afae509-4c46-4d0f-9fbf-6b349c1501ce service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:22.277341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-03d724ca-315d-4449-8039-03dfc1b62584 req-0afae509-4c46-4d0f-9fbf-6b349c1501ce service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:22.300297 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-03d724ca-315d-4449-8039-03dfc1b62584 req-0afae509-4c46-4d0f-9fbf-6b349c1501ce service nova] Creating event network-changed:81cd5932-3a95-43b6-86ae-902a62b744b9 for instance 47361729-1df7-4084-8819-76e4b8e43a1e on hv-cinder-85426 Aug 29 21:31:22.308898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-03d724ca-315d-4449-8039-03dfc1b62584 req-0afae509-4c46-4d0f-9fbf-6b349c1501ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057717 Aug 29 21:31:22.311174 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 270/579] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:24.326137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-512737e6-4394-4676-baa3-8e1d1bd93263 req-0a3395ab-ac0f-4fa8-bb26-5a92f487e8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47361729-1df7-4084-8819-76e4b8e43a1e", "tag": "81cd5932-3a95-43b6-86ae-902a62b744b9"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:24.336963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-512737e6-4394-4676-baa3-8e1d1bd93263 req-0a3395ab-ac0f-4fa8-bb26-5a92f487e8b6 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:24.337436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-512737e6-4394-4676-baa3-8e1d1bd93263 req-0a3395ab-ac0f-4fa8-bb26-5a92f487e8b6 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:24.337858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-512737e6-4394-4676-baa3-8e1d1bd93263 req-0a3395ab-ac0f-4fa8-bb26-5a92f487e8b6 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:24.350870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-512737e6-4394-4676-baa3-8e1d1bd93263 req-0a3395ab-ac0f-4fa8-bb26-5a92f487e8b6 service nova] Creating event network-changed:81cd5932-3a95-43b6-86ae-902a62b744b9 for instance 47361729-1df7-4084-8819-76e4b8e43a1e on hv-cinder-85426 Aug 29 21:31:24.356389 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-512737e6-4394-4676-baa3-8e1d1bd93263 req-0a3395ab-ac0f-4fa8-bb26-5a92f487e8b6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035003 Aug 29 21:31:24.356938 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 310/580] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:32.882249 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=31 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:32.884039 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=38 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:32.888770 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:32.893180 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:32.895712 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:32.896228 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:32.896660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:32.897365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:32.897812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:32.898230 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:32.931319 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3c030816-e335-4342-9098-8a3aa46dccbd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments/939de495-537b-4327-86da-3dd0cefd5754" status: 200 len: 194 microversion: 2.20 time: 0.054191 Aug 29 21:31:32.932095 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 271/581] 10.222.0.65 () {60 vars in 1454 bytes} [Mon Aug 29 21:31:32 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments/939de495-537b-4327-86da-3dd0cefd5754 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:31:33.011522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:33.014517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:33.019338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:33.019815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:33.020301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:33.020961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:33.021401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:33.021816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:33.309263 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lazy-loading 'services' on Instance uuid 8ce9c011-918f-4702-83d6-cd5fd83a1a3a {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:31:33.646911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c916a1e7-19bb-421b-8916-2815310a1b1a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments/939de495-537b-4327-86da-3dd0cefd5754" status: 202 len: 0 microversion: 2.20 time: 0.641398 Aug 29 21:31:33.647512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 311/582] 10.222.0.65 () {60 vars in 1457 bytes} [Mon Aug 29 21:31:33 2022] DELETE /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments/939de495-537b-4327-86da-3dd0cefd5754 => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:31:33.662558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:33.664930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:33.672618 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:33.673112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:33.673555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:33.674268 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:33.674725 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:33.675160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:33.715721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3f92cb20-5010-4341-8d77-370647fbf0fd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062594 Aug 29 21:31:33.716458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 272/583] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Aug 29 21:31:33 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:31:34.731720 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:34.734102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:34.742881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:34.743480 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:34.743775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:34.744523 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:34.745527 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:34.745936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:34.793138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5e37b68e-c220-49c2-bb9a-895c06f5c821 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066063 Aug 29 21:31:34.793966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 312/584] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Aug 29 21:31:34 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:31:35.806977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:35.809997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:35.817754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:35.818235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:35.818667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:35.819373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:35.819820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:35.820329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:35.856255 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1be5430b-f486-489b-adb2-1caf7138bd8d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053609 Aug 29 21:31:35.856850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 273/585] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Aug 29 21:31:35 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:35.930520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:35.931353 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:35.939057 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:35.939544 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:35.940019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:35.941386 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:35.941883 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:35.942806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:35.982723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:31:36.733192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-deff6d98-66e8-4c73-b229-a94ab05c9b42 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 204 len: 0 microversion: 2.20 time: 0.806346 Aug 29 21:31:36.733803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 313/586] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Aug 29 21:31:35 2022] DELETE /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 21:31:36.742811 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:36.743291 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:36.750195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:36.750686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:36.751123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:36.751848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:36.752344 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:36.752885 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:36.967751 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:36.976409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:36.977835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:36.979066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-36712121-c888-411a-8edd-da4d4bc00849 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.240790 Aug 29 21:31:36.979643 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 274/587] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:36 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:38.003277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:38.004105 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:38.010864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:38.011355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:38.011915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:38.012664 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:38.013226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:38.013546 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:38.186137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:38.201399 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:38.204576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:38.206849 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7c3167be-fd38-4535-bfcc-0f70561d1cd9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.207675 Aug 29 21:31:38.207842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 314/588] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:37 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:38.416352 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:38.419218 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:38.427474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:38.427769 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:38.428156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:38.428868 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:38.429309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:38.429726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:38.462287 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c1f6a0b7-fa0c-4202-b453-f11366ad002a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050523 Aug 29 21:31:38.462881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 275/589] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:31:38 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:31:38.534719 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:38.535324 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:38.542277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:38.542765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:38.543206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:38.543985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:38.544421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:38.544845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:38.573978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:31:39.000907 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-86c56ae6-486e-453d-9cba-b9fd1252e3e3 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 204 len: 0 microversion: 2.1 time: 0.469989 Aug 29 21:31:39.001493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 315/590] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:31:38 2022] DELETE /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:31:39.011483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:39.012271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:39.019199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:39.019757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:39.020270 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:39.021145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:39.021653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:39.022150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:39.041340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1801222901"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:39.042023 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:39.049700 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:39.050374 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:39.050883 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:39.051833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:39.052501 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:39.053141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:39.213009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.network.security_group_api [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Removing security group 0acf2c5f-488f-47e0-8f71-43ae4ca4cd6c from port f7b98ffd-df0e-4679-b056-8aebb5b15590 Aug 29 21:31:39.222477 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:39.231343 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f294acb6-3dd5-4130-8fc8-aceb236e4e5c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1672 microversion: 2.1 time: 0.225253 Aug 29 21:31:39.231948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 276/591] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:39 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:39.244081 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:39.245700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:39.252589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:39.253008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:39.253448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:39.254195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:39.254763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:39.255195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:39.424194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:39.435721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:39.437317 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:39.438776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7df1665c-ca44-4b78-8343-a82206880a4b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.198885 Aug 29 21:31:39.439407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 277/592] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:39 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:31:39.712893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-77af5c2d-96bb-46f9-b8f5-ab4e20e6a3b2 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/action" status: 202 len: 0 microversion: 2.1 time: 0.678012 Aug 29 21:31:39.714390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 316/593] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:31:39 2022] POST /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:31:39.724116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-fb4e339e-09e3-4b82-b67f-9958c1592e6a req-8e39917d-4f09-4a69-9e45-6b8b1ee6db3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd8e900-c6d1-40db-a1e7-ee9c3e703dff", "tag": "f7b98ffd-df0e-4679-b056-8aebb5b15590"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:39.734979 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-fb4e339e-09e3-4b82-b67f-9958c1592e6a req-8e39917d-4f09-4a69-9e45-6b8b1ee6db3e service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:39.735457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-fb4e339e-09e3-4b82-b67f-9958c1592e6a req-8e39917d-4f09-4a69-9e45-6b8b1ee6db3e service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:39.736155 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-fb4e339e-09e3-4b82-b67f-9958c1592e6a req-8e39917d-4f09-4a69-9e45-6b8b1ee6db3e service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:39.750055 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-fb4e339e-09e3-4b82-b67f-9958c1592e6a req-8e39917d-4f09-4a69-9e45-6b8b1ee6db3e service nova] Creating event network-changed:f7b98ffd-df0e-4679-b056-8aebb5b15590 for instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff on hv-cinder-85426 Aug 29 21:31:39.756497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-fb4e339e-09e3-4b82-b67f-9958c1592e6a req-8e39917d-4f09-4a69-9e45-6b8b1ee6db3e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038068 Aug 29 21:31:39.757241 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 278/594] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:40.258963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:40.260294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:40.271442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:40.272447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:40.273230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:40.274558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:40.275353 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:40.276641 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:40.467751 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:40.474741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:40.476926 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:40.482714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-26866710-2b4d-4445-82fc-94f30c7c4141 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1672 microversion: 2.1 time: 0.232203 Aug 29 21:31:40.483687 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 317/595] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:40 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:40.501209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:40.501702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:40.502201 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:40.502867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:40.503316 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:40.503735 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:40.712349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:40.722089 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:40.723700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:40.724928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7c728b73-02e4-413f-b0f5-bee55fb6dbd5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.258562 Aug 29 21:31:40.725507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 279/596] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:40 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:41.433258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:41.433258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:41.437410 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.438223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.438771 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.439598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.440213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.440742 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.456295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-b06a2f1b-ba46-4512-8b29-0a9d74c57494 req-79d3e479-c6ca-49ae-a31e-24dda8f8eb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd8e900-c6d1-40db-a1e7-ee9c3e703dff", "tag": "f7b98ffd-df0e-4679-b056-8aebb5b15590"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:41.468690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b06a2f1b-ba46-4512-8b29-0a9d74c57494 req-79d3e479-c6ca-49ae-a31e-24dda8f8eb99 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.469428 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b06a2f1b-ba46-4512-8b29-0a9d74c57494 req-79d3e479-c6ca-49ae-a31e-24dda8f8eb99 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.470176 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b06a2f1b-ba46-4512-8b29-0a9d74c57494 req-79d3e479-c6ca-49ae-a31e-24dda8f8eb99 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.497649 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-b06a2f1b-ba46-4512-8b29-0a9d74c57494 req-79d3e479-c6ca-49ae-a31e-24dda8f8eb99 service nova] Creating event network-changed:f7b98ffd-df0e-4679-b056-8aebb5b15590 for instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff on hv-cinder-85426 Aug 29 21:31:41.504731 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-b06a2f1b-ba46-4512-8b29-0a9d74c57494 req-79d3e479-c6ca-49ae-a31e-24dda8f8eb99 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056700 Aug 29 21:31:41.505935 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 280/597] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:41.511937 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:41.513969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:41.522215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.523223 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.524199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.525353 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.526045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.526667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.550101 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lazy-loading 'services' on Instance uuid 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:31:41.824265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3f06f29b-c85e-48a6-8f6d-afe5e0d88352 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments/7209447c-4111-44ce-bb93-e9b8c23e621a" status: 202 len: 0 microversion: 2.1 time: 0.402387 Aug 29 21:31:41.829115 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 318/598] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:31:41 2022] DELETE /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments/7209447c-4111-44ce-bb93-e9b8c23e621a => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:31:41.835732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:41.838381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:41.844913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.845766 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.846379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.847266 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.847982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.848571 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.964979 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:41.980722 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-db248b26-6b20-4ce9-83e2-f46956df5616 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1672 microversion: 2.1 time: 0.467115 Aug 29 21:31:41.987545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 281/599] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:41 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1672 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:42.000405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:42.003010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:42.012821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:42.013498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:42.014303 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:42.016096 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:42.016936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:42.018757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:42.067082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d2f7c5c3-97ff-41e6-a24e-4b5c915b47a7 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083936 Aug 29 21:31:42.074136 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 282/600] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:31:41 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:42.119544 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:42.145352 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:42.158101 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:42.162879 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a06fc2df-9837-4832-8055-0f78292d6425 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1724 microversion: 2.20 time: 0.330556 Aug 29 21:31:42.164714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 319/601] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:41 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:43.003539 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:43.004460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:43.012497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.013142 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.013676 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.014538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.015145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.015666 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.082181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:43.084707 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:43.097960 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.098855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.099391 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.100291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.100953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.101536 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.139656 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0617d800-3d26-4d91-8393-362ff177c1ae tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061709 Aug 29 21:31:43.145174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 320/602] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:31:43 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:43.198958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:43.198958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:43.208895 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.212039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.212707 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.217377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.218518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.220284 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.353592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:43.371479 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:43.375430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:43.392054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c7f8d41f-db2a-4b57-94ba-832c77a9e4b1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1656 microversion: 2.20 time: 0.203834 Aug 29 21:31:43.396096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 321/603] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:43 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1656 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:31:43.432126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-f56e3f40-5a0b-4169-be8c-d66d00e3dd78 req-52eb507e-7c23-4015-a658-82a81c9af35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528c748a-ba74-44e6-b1a7-84ab068acfcb", "name": "network-vif-deleted", "tag": "7063fec6-24ac-4c04-bef3-3f9ee9c54d76"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:43.451608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f56e3f40-5a0b-4169-be8c-d66d00e3dd78 req-52eb507e-7c23-4015-a658-82a81c9af35a service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.451608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f56e3f40-5a0b-4169-be8c-d66d00e3dd78 req-52eb507e-7c23-4015-a658-82a81c9af35a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.451608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-f56e3f40-5a0b-4169-be8c-d66d00e3dd78 req-52eb507e-7c23-4015-a658-82a81c9af35a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.458221 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:43.469061 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-f56e3f40-5a0b-4169-be8c-d66d00e3dd78 req-52eb507e-7c23-4015-a658-82a81c9af35a service nova] Creating event network-vif-deleted:7063fec6-24ac-4c04-bef3-3f9ee9c54d76 for instance 528c748a-ba74-44e6-b1a7-84ab068acfcb on hv-cinder-85426 Aug 29 21:31:43.474662 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-f56e3f40-5a0b-4169-be8c-d66d00e3dd78 req-52eb507e-7c23-4015-a658-82a81c9af35a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076480 Aug 29 21:31:43.476118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 322/604] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:43.499294 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:43.508462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7e8656fa-8d7b-451f-8e62-d6d3968a39cd tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1604 microversion: 2.1 time: 0.508978 Aug 29 21:31:43.517092 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 283/605] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:42 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1604 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:43.672168 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-93cdf547-fcce-4067-83df-688fb605db69 req-f0848a53-592e-4c1a-836c-1d2eb306c534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9c011-918f-4702-83d6-cd5fd83a1a3a", "name": "network-vif-deleted", "tag": "7d00a0ed-45ea-43c9-98bc-7122049be3a0"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:43.694723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-93cdf547-fcce-4067-83df-688fb605db69 req-f0848a53-592e-4c1a-836c-1d2eb306c534 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.701470 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-93cdf547-fcce-4067-83df-688fb605db69 req-f0848a53-592e-4c1a-836c-1d2eb306c534 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.702809 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-93cdf547-fcce-4067-83df-688fb605db69 req-f0848a53-592e-4c1a-836c-1d2eb306c534 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.729766 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-93cdf547-fcce-4067-83df-688fb605db69 req-f0848a53-592e-4c1a-836c-1d2eb306c534 service nova] Creating event network-vif-deleted:7d00a0ed-45ea-43c9-98bc-7122049be3a0 for instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a on hv-cinder-85426 Aug 29 21:31:43.736975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-93cdf547-fcce-4067-83df-688fb605db69 req-f0848a53-592e-4c1a-836c-1d2eb306c534 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076026 Aug 29 21:31:43.737881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 323/606] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:44.156250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:44.160744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:44.172987 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.173734 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.174723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.176485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.177355 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.177950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.280462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0b88d0f4-9b24-4e99-857a-bd084e0f8670 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131053 Aug 29 21:31:44.286914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 284/607] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:31:44 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:31:44.301229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:44.307728 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:44.334795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.335974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.336908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.338441 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.339601 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.341287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.441375 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:44.443119 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:44.456612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.457744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.459418 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.461302 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.462368 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.463469 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.483968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] HTTP exception thrown: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff is not attached to volume 7209447c-4111-44ce-bb93-e9b8c23e621a Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Request method failure captured: Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: DELETE /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments/7209447c-4111-44ce-bb93-e9b8c23e621a HTTP/1.1 Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS-JGQlbl61n71iFjaFnce6tiRaV6hYXWA5exq7IODBF6iXrfCeeTCLeQhWeNJepY6y3uU4zo7lyqnyRu6YLlBAWRt4CzmUYfXQ5dd2TLdIVOgl68HQpb-6NkMarXr2p33GfLnygZg_SUyUn4TUSzTsSLVvD2lNibILqw6YdAJC37LQ Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 52ac0b73cab4494ab39d80f06c54e9da Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-TestMinimumBasicScenario-1957585415 Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:31:44.486609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/52ac0b73cab4494ab39d80f06c54e9da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_52ac0b73cab4494ab39d80f06c54e9da", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/52ac0b73cab4494ab39d80f06c54e9da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/52ac0b73cab4494ab39d80f06c54e9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-TestMinimumBasicScenario-1957585415 Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 52ac0b73cab4494ab39d80f06c54e9da Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1957585415 Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-TestMinimumBasicScenario-1957585415-project Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 2e02c6c1c3bc49e8a63f0533c3ea5391 Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-TestMinimumBasicScenario-1957585415-project Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:31:44.489467 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff is not attached to volume 7209447c-4111-44ce-bb93-e9b8c23e621a Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'server_id': '0cd8e900-c6d1-40db-a1e7-ee9c3e703dff', 'id': '7209447c-4111-44ce-bb93-e9b8c23e621a'} Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7209447c-4111-44ce-bb93-e9b8c23e621a. Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:31:44.490821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff is not attached to volume 7209447c-4111-44ce-bb93-e9b8c23e621a Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff is not attached to volume 7209447c-4111-44ce-bb93-e9b8c23e621a Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:44.493214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Returning 404 to user: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff is not attached to volume 7209447c-4111-44ce-bb93-e9b8c23e621a {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:31:44.495613 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-43b9efa7-61e1-471a-866e-85f37e8dce1e tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments/7209447c-4111-44ce-bb93-e9b8c23e621a" status: 404 len: 154 microversion: 2.1 time: 0.197648 Aug 29 21:31:44.504102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 324/608] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:31:44 2022] DELETE /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff/os-volume_attachments/7209447c-4111-44ce-bb93-e9b8c23e621a => generated 154 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:31:44.535685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.535685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.535685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.535685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lazy-loading 'fault' on Instance uuid 8ce9c011-918f-4702-83d6-cd5fd83a1a3a {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:31:44.554968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:44.555688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:44.569154 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.569751 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.570260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.571118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.571647 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.572164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.593341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:44.631325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:44.636727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:44.642635 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ed9cd38a-cac4-49fa-aacc-dd3dc72bd3e9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1372 microversion: 2.20 time: 0.206660 Aug 29 21:31:44.644235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 285/609] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:44 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:31:44.701499 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:44.702540 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:44.705583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:44.705583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lazy-loading 'fault' on Instance uuid 528c748a-ba74-44e6-b1a7-84ab068acfcb {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:31:44.755966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:44.767582 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-10f41ea5-2a6f-4954-8d15-8399d10192f7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 200 len: 1326 microversion: 2.1 time: 0.217750 Aug 29 21:31:44.768831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 325/610] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:44 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:45.668620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:45.677082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:45.677082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:45.677082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:45.677082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:45.677454 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:45.677954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:45.678448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:45.716278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:45.716534 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:45.717275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:45.717824 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lazy-loading 'fault' on Instance uuid 8ce9c011-918f-4702-83d6-cd5fd83a1a3a {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:31:45.773353 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:45.781776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:45.783209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:45.784386 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4d9c2fdb-b75b-46c4-8c95-14b2121e3636 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 200 len: 1372 microversion: 2.20 time: 0.120638 Aug 29 21:31:45.784946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 286/611] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:45 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:45.790603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:45.791304 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:45.799003 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:45.799567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:45.800101 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:45.800805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:45.801251 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:45.801667 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:45.817066 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] HTTP exception thrown: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Request method failure captured: Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb HTTP/1.1 Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8YVQOS1Lri69Wufc5zEm_DiPcCKVM1yJmp_eT1AS3fi26FOjFSOKlqdETUu-igl9Dj8RJNbmQiddSZwnrURn-IMpw9BxRt7Xe4UHO4DrjgGL_oRvKf3la9gFU47LjWMOjxX9Gb8uFDde3XTyQ8uu-tEFoRzH-FMioNBhG5cYdJRC0 Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:31:45.818599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8d35a885c494e11b42f556554f3698b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: d3c5edb153624912b87d61dd7ad5e4f3 Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:31:45.820295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '528c748a-ba74-44e6-b1a7-84ab068acfcb'} Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:31:45.821417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:31:45.823943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:45.825459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Returning 404 to user: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:31:45.825459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-95d1ac92-6795-413f-af34-0f0492710505 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 404 len: 111 microversion: 2.1 time: 0.033359 Aug 29 21:31:45.825459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 326/612] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:45 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:31:45.830098 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-cc9aeef9-0469-401e-90df-9699dff7167e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '.version_select at 0x7fc84009c700>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:45.934667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-cc9aeef9-0469-401e-90df-9699dff7167e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-187429163" status: 202 len: 0 microversion: 2.1 time: 0.108252 Aug 29 21:31:45.935589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 287/613] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Aug 29 21:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-187429163 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:31:45.954687 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:45.955199 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:45.962685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:45.963716 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:45.963947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:45.964531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:45.964992 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:45.965421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:45.997277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:31:46.338852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b9a13702-6eee-431c-8c88-468dc97a7720 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 204 len: 0 microversion: 2.1 time: 0.387475 Aug 29 21:31:46.339471 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 327/614] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:31:45 2022] DELETE /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:31:46.350294 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:46.351105 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:46.360082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:46.360523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:46.360957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:46.361759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:46.362229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:46.362650 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:46.600284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:46.615051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d81223fd-bea4-413d-ad40-097c7d488ff1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1554 microversion: 2.1 time: 0.268353 Aug 29 21:31:46.616153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 288/615] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:46 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:46.808319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:46.809062 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:46.816225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:46.816710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:46.817139 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:46.817834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:46.818280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:46.818697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:46.833152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] HTTP exception thrown: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Request method failure captured: Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a HTTP/1.1 Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS9uM1iTJJGNIzT5jmR0NgnEbaOkdeIDyvQKoWmZFFcYNPNZu2fzByLWTOo_LltfqoboQnKhjcVRKN95eF3Q2QV6_BAALO0RDrCgzC8Yt3H6CbGLeafC1_ekwb20qDz6qOYJ-JZrDYqqt6m7QTZ40Tl86pMqeEvgFk4FHSN58ZOrp-g Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:31:46.834801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5bc75af3ba6c442889ce29351414e110", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 0e3f8c861a9c49119fc531e2a159ec9d Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:31:46.836511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '8ce9c011-918f-4702-83d6-cd5fd83a1a3a'} Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:31:46.837798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:31:46.839297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:31:46.840651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Returning 404 to user: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:31:46.840651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-54376b64-fed5-4a16-b821-828bb060a629 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 404 len: 111 microversion: 2.20 time: 0.033102 Aug 29 21:31:46.840651 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 328/616] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:46 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:31:46.849344 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-231260b8-a275-4f83-998f-9c25aed32e1d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '.version_select at 0x7fc8400ac310>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:46.951409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-231260b8-a275-4f83-998f-9c25aed32e1d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247925955" status: 204 len: 0 microversion: 2.20 time: 0.107819 Aug 29 21:31:46.952084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 289/617] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Aug 29 21:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247925955 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:31:47.057180 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5572a5ab-e9a3-40ac-8147-96643bba7816 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'create', calling method: .version_select at 0x7fc84011c790>, body: {"keypair": {"name": "tempest-keypair-964879610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1W5olJpbjdpW0cr+pUmpfke71QyyaO/7VUQ/gBRVPODdQ7j+6rLRPl7941m9be1gaCYwBqLPyd/6KEyKk72mgJgC5FgEnh/k4P+7n1CSLngkUjNtxtWEm1lUfyMxC4uw=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:47.075837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-5572a5ab-e9a3-40ac-8147-96643bba7816 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for project d8d35a885c494e11b42f556554f3698b. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:31:47.081254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-5572a5ab-e9a3-40ac-8147-96643bba7816 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for user d3c5edb153624912b87d61dd7ad5e4f3 and project d8d35a885c494e11b42f556554f3698b. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:31:47.191169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5572a5ab-e9a3-40ac-8147-96643bba7816 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.138305 Aug 29 21:31:47.191832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 329/618] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:31:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:47.646623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:47.647425 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:47.655486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:47.656277 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:47.657064 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:47.657986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:47.658559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:47.659163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:47.665982 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:47.841018 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:47.854569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-017630f2-3ade-45ab-b662-817987e64f65 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1554 microversion: 2.1 time: 0.212274 Aug 29 21:31:47.856638 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 290/619] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:47 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:31:48.203559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d7d4ad7b-8724-4094-bb29-427c7ac4de0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'create', calling method: .version_select at 0x7fc840100790>, body: {"keypair": {"name": "tempest-keypair-1538128629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7KRGNl/A/2Vln6vbnx5cSui1ZsaBlX02Wy/jrNOyXy9eeJgpwSQEnlN5l55VVzYMDyx7T0CoVPwTE0jstRTGewciPg2DWtTtTdNzddVQyaOJNJHZ1xn7/pm2JCyAaKoA=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:48.234342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-d7d4ad7b-8724-4094-bb29-427c7ac4de0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for project 5bc75af3ba6c442889ce29351414e110. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:31:48.241481 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-d7d4ad7b-8724-4094-bb29-427c7ac4de0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for user 0e3f8c861a9c49119fc531e2a159ec9d and project 5bc75af3ba6c442889ce29351414e110. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:31:48.362510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d7d4ad7b-8724-4094-bb29-427c7ac4de0e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.167307 Aug 29 21:31:48.363114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 330/620] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Aug 29 21:31:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 21:31:48.884056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:48.886005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:48.898012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:48.898998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:48.902152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:48.902152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:48.902152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:48.902706 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:49.148888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:49.161150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6b131180-b271-4d47-a294-ec98deb5ac61 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1554 microversion: 2.1 time: 0.285204 Aug 29 21:31:49.161899 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 291/621] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:48 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:49.378911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-ebe793a4-51bc-42a7-bd3f-07284ace918b req-8556f261-2de4-4f25-b0e7-bd333688298e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd8e900-c6d1-40db-a1e7-ee9c3e703dff", "name": "network-vif-deleted", "tag": "f7b98ffd-df0e-4679-b056-8aebb5b15590"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:49.389686 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ebe793a4-51bc-42a7-bd3f-07284ace918b req-8556f261-2de4-4f25-b0e7-bd333688298e service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:49.390288 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ebe793a4-51bc-42a7-bd3f-07284ace918b req-8556f261-2de4-4f25-b0e7-bd333688298e service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:49.395228 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ebe793a4-51bc-42a7-bd3f-07284ace918b req-8556f261-2de4-4f25-b0e7-bd333688298e service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:49.404384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-ebe793a4-51bc-42a7-bd3f-07284ace918b req-8556f261-2de4-4f25-b0e7-bd333688298e service nova] Creating event network-vif-deleted:f7b98ffd-df0e-4679-b056-8aebb5b15590 for instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff on hv-cinder-85426 Aug 29 21:31:49.409667 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-ebe793a4-51bc-42a7-bd3f-07284ace918b req-8556f261-2de4-4f25-b0e7-bd333688298e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034448 Aug 29 21:31:49.410602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 331/622] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:50.186506 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:50.187286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:50.199362 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:50.200386 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:50.201279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:50.202373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:50.203370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:50.206592 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:50.269673 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:50.270684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:50.271497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:50.272256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lazy-loading 'fault' on Instance uuid 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:31:50.333305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e02c6c1c3bc49e8a63f0533c3ea5391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac0b73cab4494ab39d80f06c54e9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:50.341844 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6cf79914-facb-4300-a585-0961cc0065ec tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 200 len: 1348 microversion: 2.1 time: 0.162115 Aug 29 21:31:50.342686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 292/623] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:50 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 1348 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:51.156544 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-117679943", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca335ec8-2cdb-4727-aad4-e94fc1adcada"}], "security_groups": [{"name": "tempest-securitygroup--1920057353"}], "key_name": "tempest-keypair-964879610", "user_data": "}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:51.317379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.network.neutron [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] validate_networks() for [('ca335ec8-2cdb-4727-aad4-e94fc1adcada', None, None, None, None, None)] {{(pid=121558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:31:51.382760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:51.385827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] [instance: 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:51.397959 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:51.399342 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:51.400405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:51.402646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:51.403740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:51.404760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:51.433725 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] HTTP exception thrown: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff could not be found. Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Request method failure captured: Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff HTTP/1.1 Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS-JGQlbl61n71iFjaFnce6tiRaV6hYXWA5exq7IODBF6iXrfCeeTCLeQhWeNJepY6y3uU4zo7lyqnyRu6YLlBAWRt4CzmUYfXQ5dd2TLdIVOgl68HQpb-6NkMarXr2p33GfLnygZg_SUyUn4TUSzTsSLVvD2lNibILqw6YdAJC37LQ Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 52ac0b73cab4494ab39d80f06c54e9da Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-TestMinimumBasicScenario-1957585415 Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:31:51.437210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/52ac0b73cab4494ab39d80f06c54e9da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_52ac0b73cab4494ab39d80f06c54e9da", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/52ac0b73cab4494ab39d80f06c54e9da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/52ac0b73cab4494ab39d80f06c54e9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-TestMinimumBasicScenario-1957585415 Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 52ac0b73cab4494ab39d80f06c54e9da Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1957585415 Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-TestMinimumBasicScenario-1957585415-project Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 2e02c6c1c3bc49e8a63f0533c3ea5391 Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-TestMinimumBasicScenario-1957585415-project Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff could not be found. Aug 29 21:31:51.438825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '0cd8e900-c6d1-40db-a1e7-ee9c3e703dff'} Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff could not be found. Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:31:51.439732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff could not be found. Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff could not be found. Aug 29 21:31:51.441187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:31:51.442432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Returning 404 to user: Instance 0cd8e900-c6d1-40db-a1e7-ee9c3e703dff could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:31:51.442432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5f6e4392-34af-4417-852a-32a94a6c4564 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff" status: 404 len: 111 microversion: 2.1 time: 0.065568 Aug 29 21:31:51.442432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 293/624] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:51 2022] GET /compute/v2.1/servers/0cd8e900-c6d1-40db-a1e7-ee9c3e703dff => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:31:51.452525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-63403844-d6a3-4c72-95d0-cb654e10c3b1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] Calling method '.version_select at 0x7fc84009ce50>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:51.575226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-63403844-d6a3-4c72-95d0-cb654e10c3b1 tempest-TestMinimumBasicScenario-1957585415 tempest-TestMinimumBasicScenario-1957585415-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1941309463" status: 202 len: 0 microversion: 2.1 time: 0.127804 Aug 29 21:31:51.577097 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 294/625] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Aug 29 21:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1941309463 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:31:51.944447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Flavor limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:31:51.944915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Image limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:31:51.945382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Flavor pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:31:51.945787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Image pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:31:51.946198 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:31:51.961220 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:51.962092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:51.962619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:51.963539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:51.964225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:51.964741 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:51.996219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for project d8d35a885c494e11b42f556554f3698b. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:31:52.004208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Getting quotas for user d3c5edb153624912b87d61dd7ad5e4f3 and project d8d35a885c494e11b42f556554f3698b. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:31:52.018486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Going to run 1 instances... {{(pid=121558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:31:52.021302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:31:52.037679 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:52.251043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-556896057", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48dd2592-6ea0-414d-a1c9-f95709b58170"}], "security_groups": [{"name": "tempest-securitygroup--65317653"}], "key_name": "tempest-keypair-1538128629", "user_data": "}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:31:52.308655 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d4a4fe35-a1b7-47c9-89e1-7f2b813fca17 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.277805 Aug 29 21:31:52.310081 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 332/626] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:31:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:31:52.333748 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-620d392f-34e3-4f20-bd25-0dcfc7e72e29 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:52.334547 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-620d392f-34e3-4f20-bd25-0dcfc7e72e29 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:52.403864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] validate_networks() for [('48dd2592-6ea0-414d-a1c9-f95709b58170', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:31:52.432989 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-620d392f-34e3-4f20-bd25-0dcfc7e72e29 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:52.442445 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-620d392f-34e3-4f20-bd25-0dcfc7e72e29 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1236 microversion: 2.1 time: 0.113210 Aug 29 21:31:52.443044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 333/627] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:52 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:52.932398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:31:52.932823 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:31:52.933335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:31:52.933737 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:31:52.934150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:31:52.944120 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:52.944617 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:52.945053 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:52.945791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:52.946273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:52.946705 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:52.967421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for project 5bc75af3ba6c442889ce29351414e110. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:31:52.972374 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Getting quotas for user 0e3f8c861a9c49119fc531e2a159ec9d and project 5bc75af3ba6c442889ce29351414e110. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:31:52.986259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:31:52.988845 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:31:53.134937 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a2540783-931e-4c32-af90-07862835ba98 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.888519 Aug 29 21:31:53.137112 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 295/628] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Aug 29 21:31:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 21:31:53.153250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f67667bc-4114-4058-892f-b4a8b17b75c1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:53.154186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f67667bc-4114-4058-892f-b4a8b17b75c1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:53.237186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f67667bc-4114-4058-892f-b4a8b17b75c1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:53.256332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f67667bc-4114-4058-892f-b4a8b17b75c1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:53.262034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f67667bc-4114-4058-892f-b4a8b17b75c1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:53.265568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f67667bc-4114-4058-892f-b4a8b17b75c1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1281 microversion: 2.20 time: 0.119864 Aug 29 21:31:53.268750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 334/629] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:53 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:53.469827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a5ea3353-fc53-4475-abb2-e9a59a6d1ff7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:53.470914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a5ea3353-fc53-4475-abb2-e9a59a6d1ff7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:53.542507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a5ea3353-fc53-4475-abb2-e9a59a6d1ff7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:53.556293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a5ea3353-fc53-4475-abb2-e9a59a6d1ff7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1236 microversion: 2.1 time: 0.093395 Aug 29 21:31:53.557907 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 296/630] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:53 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1236 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:54.304394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4413c2e2-6a1e-470b-8cbc-12fb15de5e48 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:54.305137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4413c2e2-6a1e-470b-8cbc-12fb15de5e48 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:54.421433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4413c2e2-6a1e-470b-8cbc-12fb15de5e48 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:54.436131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4413c2e2-6a1e-470b-8cbc-12fb15de5e48 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:54.439823 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4413c2e2-6a1e-470b-8cbc-12fb15de5e48 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:54.442090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4413c2e2-6a1e-470b-8cbc-12fb15de5e48 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1281 microversion: 2.20 time: 0.141265 Aug 29 21:31:54.443158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 335/631] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:54 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:54.584728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:54.585787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:54.599314 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:54.600101 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:54.600710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:54.601589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:54.602186 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:54.603002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:54.726451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:54.736192 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-30e595d7-c74e-4a63-a1a0-ccf33b23183d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1288 microversion: 2.1 time: 0.158610 Aug 29 21:31:54.737060 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 297/632] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:54 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1288 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:55.487640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:55.488634 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:55.498161 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:55.498711 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:55.499154 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:55.499957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:55.500433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:55.500880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:55.631315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:55.642368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:55.645180 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:55.645443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e20af53a-c717-485b-a020-f71c8b34be94 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1333 microversion: 2.20 time: 0.165658 Aug 29 21:31:55.646291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 336/633] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:55 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1333 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:55.772460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:55.780974 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:55.801495 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:55.802516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:55.803617 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:55.812532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:55.812532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:55.812532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:55.976157 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:55.992335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a8889194-5455-4228-ae40-b818d6d90896 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1296 microversion: 2.1 time: 0.227610 Aug 29 21:31:55.993993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 298/634] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:55 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1296 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:56.680315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:56.682416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:56.701958 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:56.702750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:56.703393 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:56.704367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:56.705023 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:56.705897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:56.883322 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:56.896642 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:56.898666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:56.901282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d8e2a09d-ae79-41be-87a3-c06f59df82d5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1341 microversion: 2.20 time: 0.224283 Aug 29 21:31:56.915957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 337/635] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:56 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:57.029981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:57.030956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:57.048664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:57.049913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:57.051796 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:57.053584 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:57.054726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:57.055829 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:57.160754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:57.174489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4ef5f6f5-46a5-4138-975e-7fd952c2c61f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1294 microversion: 2.1 time: 0.149766 Aug 29 21:31:57.196249 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 299/636] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:57 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:57.944913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:57.947384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:57.959639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:57.960896 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:57.961863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:57.964100 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:57.965411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:57.966379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:58.075738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:58.090788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:58.093704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:58.095740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-aa1e68d0-44dd-40f2-8b17-350348439b90 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1339 microversion: 2.20 time: 0.157795 Aug 29 21:31:58.096794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 338/637] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:57 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:31:58.212674 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:58.214927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:58.231611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:58.234377 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:58.236555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:58.239593 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:58.241695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:58.243602 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:58.609462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:58.618515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8f123354-f1e8-4465-8ca7-e6bc0804747e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.412024 Aug 29 21:31:58.619679 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 300/638] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:58 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:59.144632 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:59.145261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:59.163039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:59.163535 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:59.164193 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:59.165513 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:59.166181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:59.166924 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:59.465658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:59.495093 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:59.495093 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:31:59.496306 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a307995c-2578-4186-ad29-f1633d0b7cf6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.371505 Aug 29 21:31:59.497086 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 339/639] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:31:59 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:59.642909 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:59.643866 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:31:59.652733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:59.653226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:59.653877 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:59.655007 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:59.655685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:59.656162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:00.057163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:00.072334 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1e258753-368b-409e-8103-c0cbe4194ef8 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.433594 Aug 29 21:32:00.074664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 301/640] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:31:59 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:00.391332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-fa3c960a-052a-4544-8059-9d2b2a437065 req-797c6c11-8d0a-4e33-b2ae-b76802261a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bd4734-3240-4f81-b09d-3579374dcf37", "tag": "1f7519bf-31a6-4fc4-a960-21b24ae8df99"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:00.417865 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-fa3c960a-052a-4544-8059-9d2b2a437065 req-797c6c11-8d0a-4e33-b2ae-b76802261a23 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:00.418601 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-fa3c960a-052a-4544-8059-9d2b2a437065 req-797c6c11-8d0a-4e33-b2ae-b76802261a23 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:00.419496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-fa3c960a-052a-4544-8059-9d2b2a437065 req-797c6c11-8d0a-4e33-b2ae-b76802261a23 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:00.448191 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-fa3c960a-052a-4544-8059-9d2b2a437065 req-797c6c11-8d0a-4e33-b2ae-b76802261a23 service nova] Creating event network-changed:1f7519bf-31a6-4fc4-a960-21b24ae8df99 for instance 14bd4734-3240-4f81-b09d-3579374dcf37 on hv-cinder-85426 Aug 29 21:32:00.462453 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-fa3c960a-052a-4544-8059-9d2b2a437065 req-797c6c11-8d0a-4e33-b2ae-b76802261a23 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080768 Aug 29 21:32:00.467997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 340/641] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:00.545200 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:00.546276 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:00.556352 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:00.557404 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:00.558326 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:00.559315 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:00.563047 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:00.564020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:00.915572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:00.927262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:00.929938 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:00.931399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b83f3845-2cc7-4f29-95bd-79f5d6146224 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.400399 Aug 29 21:32:00.932588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 302/642] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:00 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:01.108280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:01.108979 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:01.117523 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:01.118138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:01.118682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:01.119433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:01.120114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:01.120552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:01.320907 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:01.330469 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0b1e710d-8564-4318-9bbf-b312229f8e36 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.226471 Aug 29 21:32:01.331599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 341/643] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:01 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:01.970103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:01.972655 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:01.984319 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:01.985477 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:01.986215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:01.988127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:01.988914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:01.989703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:02.179713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:02.193187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:02.195004 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:02.196542 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f174290d-76a0-411f-967a-b8d83ace64f6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.233330 Aug 29 21:32:02.197630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 303/644] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:01 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:32:02.377904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:02.402476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:02.420126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:02.423194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:02.425368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:02.426103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:02.427310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:02.428091 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:02.438143 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:02.493252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-14e92c54-e74a-414f-a9d5-d4ee754bc314 req-cba43801-934f-4db3-9dfd-8308acf47dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed516ef-b559-450d-b615-b95c82908ee2", "tag": "66c8e05e-f016-4ff0-8e7c-2e45a091431f"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:02.510687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-14e92c54-e74a-414f-a9d5-d4ee754bc314 req-cba43801-934f-4db3-9dfd-8308acf47dcf service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:02.511295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-14e92c54-e74a-414f-a9d5-d4ee754bc314 req-cba43801-934f-4db3-9dfd-8308acf47dcf service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:02.511744 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-14e92c54-e74a-414f-a9d5-d4ee754bc314 req-cba43801-934f-4db3-9dfd-8308acf47dcf service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:02.525706 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-14e92c54-e74a-414f-a9d5-d4ee754bc314 req-cba43801-934f-4db3-9dfd-8308acf47dcf service nova] Creating event network-changed:66c8e05e-f016-4ff0-8e7c-2e45a091431f for instance 9ed516ef-b559-450d-b615-b95c82908ee2 on hv-cinder-85426 Aug 29 21:32:02.531506 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-14e92c54-e74a-414f-a9d5-d4ee754bc314 req-cba43801-934f-4db3-9dfd-8308acf47dcf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042783 Aug 29 21:32:02.532143 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 304/645] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:02.707223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:02.720550 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-02ab57fa-9b8e-409f-92b6-c1cd67badb51 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.362774 Aug 29 21:32:02.721461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 342/646] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:02 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:03.233026 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:03.240945 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:03.241792 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:03.245603 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:03.254555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.268804 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.268804 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.268804 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.268804 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.269444 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.422036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:03.432609 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:03.434162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:03.435293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8fa41259-9ddd-4ed2-afad-1632815b9163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.203860 Aug 29 21:32:03.435850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 305/647] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:03 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:03.646727 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:03.647750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:03.662937 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.663829 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.665639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.666737 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.667913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.668718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.747593 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:03.748726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:03.760820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=8 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:03.762088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.762749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.763028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.769061 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.769980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.770821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.818602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'services' on Instance uuid 47361729-1df7-4084-8819-76e4b8e43a1e {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:04.107196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:04.117084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-647f1ccf-a1f6-4a03-a9b6-404bfa8b5473 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.374786 Aug 29 21:32:04.117816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 306/648] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:03 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:04.275730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1b5495b7-1dbe-4c31-b2a4-7e407444d164 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "DELETE /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments/0340c9de-ec52-437f-9554-10c816aab59e" status: 202 len: 0 microversion: 2.1 time: 0.636902 Aug 29 21:32:04.278238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 343/649] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:32:03 2022] DELETE /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments/0340c9de-ec52-437f-9554-10c816aab59e => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:32:04.287761 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:04.290814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:04.300065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:04.300565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:04.301066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:04.301912 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:04.302535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:04.302980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:04.337752 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-439e63ad-b7e7-4578-98d5-6aab7b803008 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054147 Aug 29 21:32:04.338400 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 307/650] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:32:04 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:04.468088 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:04.471099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:04.474772 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=20 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:04.491285 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:04.491792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:04.503551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:04.505549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:04.506066 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:04.506521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:05.149530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:05.151104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:05.162082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:05.162994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:05.163850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:05.165412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:05.166770 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:05.167868 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:05.172040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:05.179340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:05.181680 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:05.183232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e8692cf9-c53a-4b9b-a901-4cdd12057ec6 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.727218 Aug 29 21:32:05.184769 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 344/651] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:04 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:32:05.416578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:05.421913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:05.422407 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:05.426701 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-21d5e53f-18de-4e2e-930e-f2f68e0c620f tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.283115 Aug 29 21:32:05.428252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 308/652] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:05 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:05.430034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:05.430576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:05.431009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:05.432813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:05.432813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:05.433152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:05.434535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:05.436679 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:05.443699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:05.444610 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:05.445310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:05.446231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:05.446875 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:05.447567 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:05.472978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a42cf4f6-062e-4318-b81e-98335915b9dd tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/ips" status: 200 len: 151 microversion: 2.1 time: 0.181579 Aug 29 21:32:05.473723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 345/653] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:32:05 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/ips => generated 151 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:05.491080 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d4442ffc-2b39-4ae1-bf4a-772068395cfa tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056391 Aug 29 21:32:05.491080 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 309/654] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:32:05 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:06.225427 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:06.226082 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:06.241892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.241892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.241892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.241892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.242991 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.242991 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.242991 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:06.450039 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:06.450987 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:06.463133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.464085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.464768 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.465761 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.466519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.467171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.494684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:06.503527 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:06.530369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:06.534156 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:06.537313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ae06a3bb-cbf5-4b4e-b34a-7e5f7544a593 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.315716 Aug 29 21:32:06.538757 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 346/655] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:06 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:32:06.549026 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:06.553792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:06.574554 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.574554 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.574554 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.575438 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.580069 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.581556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.627063 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a09c5a3b-5b2e-4e7a-a20b-d9abe0a0bc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086497 Aug 29 21:32:06.627856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 347/656] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:32:06 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:32:06.698365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:06.707833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2cacd9e0-7c00-4a09-9392-413d5e6cdc46 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.261820 Aug 29 21:32:06.708467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 310/657] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:06 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:06.731238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:06.732158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:06.744429 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.745317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.746060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.747382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:06.748235 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:06.752443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:06.804669 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:32:07.204486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1cb9ee5d-c967-41e8-aa29-3839d88a5169 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "DELETE /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 204 len: 0 microversion: 2.1 time: 0.478925 Aug 29 21:32:07.205656 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 348/658] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:32:06 2022] DELETE /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:32:07.214528 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:07.216141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:07.223381 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.223869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.225307 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.226254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.226905 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.227502 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.395783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:07.415178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b7d1ae5d-a4ea-4c00-b1b1-ad548c82b105 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1685 microversion: 2.1 time: 0.204806 Aug 29 21:32:07.416759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 311/659] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:07 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:07.463158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cc66c77-3b18-4d48-997e-a6f8b02fda9d"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:07.465876 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:07.474388 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.474875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.475310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.476149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.476601 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.477023 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.570182 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:07.570182 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:07.574364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.575187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.575572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.576354 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.577055 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.577718 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.756786 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:07.768998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:07.770395 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:07.771518 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-bb09847a-12dc-4588-9cea-8e9bbc37612f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.212196 Aug 29 21:32:07.772125 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 312/660] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:07 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:07.780519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-3c9b7f7c-b4b5-4a20-b01f-b4dd251f019e req-8aa778dc-972e-4401-87d3-1a51318f60a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bd4734-3240-4f81-b09d-3579374dcf37", "name": "network-vif-plugged", "status": "completed", "tag": "1f7519bf-31a6-4fc4-a960-21b24ae8df99"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:07.796266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-3c9b7f7c-b4b5-4a20-b01f-b4dd251f019e req-8aa778dc-972e-4401-87d3-1a51318f60a1 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.796970 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-3c9b7f7c-b4b5-4a20-b01f-b4dd251f019e req-8aa778dc-972e-4401-87d3-1a51318f60a1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.797954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-3c9b7f7c-b4b5-4a20-b01f-b4dd251f019e req-8aa778dc-972e-4401-87d3-1a51318f60a1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.814225 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-3c9b7f7c-b4b5-4a20-b01f-b4dd251f019e req-8aa778dc-972e-4401-87d3-1a51318f60a1 service nova] Creating event network-vif-plugged:1f7519bf-31a6-4fc4-a960-21b24ae8df99 for instance 14bd4734-3240-4f81-b09d-3579374dcf37 on hv-cinder-85426 Aug 29 21:32:07.824890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-3c9b7f7c-b4b5-4a20-b01f-b4dd251f019e req-8aa778dc-972e-4401-87d3-1a51318f60a1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046559 Aug 29 21:32:07.824890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 313/661] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:07.827923 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:07.828646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:07.835106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.835631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.836391 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:07.837127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:07.838153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:07.838590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:08.016518 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:08.024703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d151360d-1d21-4a36-a8d4-340bf7a16904 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.202740 Aug 29 21:32:08.025321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 314/662] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:07 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:08.446487 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:08.447297 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:08.453760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:08.454270 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:08.454685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:08.455516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:08.456018 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:08.456446 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:08.615330 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:08.627445 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-80b69f12-58a6-4616-8207-96b97b75a659 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1685 microversion: 2.1 time: 0.184679 Aug 29 21:32:08.628058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 315/663] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:08 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:08.797721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:08.798578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:08.805546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:08.808482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:08.808482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:08.808482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:08.808482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:08.809144 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:08.959625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:08.973168 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:08.975791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:08.977867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-963c48f1-6121-4a59-aba7-c12097358683 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.184072 Aug 29 21:32:08.979256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 316/664] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:08 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:32:09.054899 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:09.055500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:09.061805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:09.062287 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:09.062721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:09.063508 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:09.064002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:09.081245 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:09.216329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:09.225430 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-78bdb938-0aad-4331-9f0e-9165503f1553 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.175943 Aug 29 21:32:09.226067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 317/665] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:09 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:09.649724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:09.650609 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:09.658158 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:09.658928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:09.659542 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:09.660391 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:09.661108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:09.661743 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:09.823913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:09.832366 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-438380ae-c78c-4d6c-bfe3-94022c055f86 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1685 microversion: 2.1 time: 0.186861 Aug 29 21:32:09.832989 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 318/666] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:09 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:09.837848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-be283d0d-f406-4b69-b5f4-db20e1637a50 req-6052b626-2a2c-4610-8a4f-7d6622b98944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed516ef-b559-450d-b615-b95c82908ee2", "name": "network-vif-plugged", "status": "completed", "tag": "66c8e05e-f016-4ff0-8e7c-2e45a091431f"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:09.848365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-be283d0d-f406-4b69-b5f4-db20e1637a50 req-6052b626-2a2c-4610-8a4f-7d6622b98944 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:09.848850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-be283d0d-f406-4b69-b5f4-db20e1637a50 req-6052b626-2a2c-4610-8a4f-7d6622b98944 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:09.849283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-be283d0d-f406-4b69-b5f4-db20e1637a50 req-6052b626-2a2c-4610-8a4f-7d6622b98944 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:09.866847 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-be283d0d-f406-4b69-b5f4-db20e1637a50 req-6052b626-2a2c-4610-8a4f-7d6622b98944 service nova] Creating event network-vif-plugged:66c8e05e-f016-4ff0-8e7c-2e45a091431f for instance 9ed516ef-b559-450d-b615-b95c82908ee2 on hv-cinder-85426 Aug 29 21:32:09.872951 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-be283d0d-f406-4b69-b5f4-db20e1637a50 req-6052b626-2a2c-4610-8a4f-7d6622b98944 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038665 Aug 29 21:32:09.873594 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 319/667] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:10.003449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:10.004116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:10.011351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:10.011828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:10.012292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:10.013127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:10.013579 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:10.013995 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:10.161244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:10.170251 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:10.171679 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:10.172811 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-58f3ec9f-f77d-4a13-b963-b8aa931d11a5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.173931 Aug 29 21:32:10.173365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 320/668] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:09 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:32:10.248032 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:10.248646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:10.255016 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:10.255520 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:10.255863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:10.256611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:10.257060 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:10.257489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:10.402313 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:10.410682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-042f2114-eaad-471a-a99a-1fab6a0cc4d6 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.167555 Aug 29 21:32:10.411553 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 321/669] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:10 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:10.854872 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:10.860372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:10.867647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:10.868501 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:10.869185 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:10.870095 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:10.870748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:10.871338 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:11.128762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:11.138066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1fd09d7a-bd45-47bd-8f6a-e2b57fe0e967 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1685 microversion: 2.1 time: 0.287395 Aug 29 21:32:11.138965 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 322/670] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:10 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1685 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:11.196267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:11.197505 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:11.204129 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:11.208830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:11.208830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:11.208830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:11.208830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:11.209229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:11.330969 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-82d0a052-1504-449d-bc2e-f1969697f73d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.874467 Aug 29 21:32:11.336951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 349/671] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:32:07 2022] POST /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments => generated 194 bytes in 3877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:11.433650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:11.434382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:11.444877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:11.445451 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:11.446051 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:11.447779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:11.447779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:11.447779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:11.457631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:11.469878 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:11.472804 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:11.473268 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-63c90c02-9ed2-432b-9e1f-acee26ede159 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.281333 Aug 29 21:32:11.473850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 323/672] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:11 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:32:11.609447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:11.617625 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d3eccace-ad1e-4e2a-9425-0cc0f565d28c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1362 microversion: 2.1 time: 0.188803 Aug 29 21:32:11.626504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 350/673] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:11 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:12.163941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:12.165269 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:12.173073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.173709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.174455 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.175585 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.176423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.177074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.256190 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:12.270790 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a554c3ca-9bfb-473b-b0e7-8d6ec4a54143 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1618 microversion: 2.1 time: 0.110976 Aug 29 21:32:12.283953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 351/674] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:12 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1618 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:12.402022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-b0314912-3148-4015-89a6-99d3aff75690 req-6c4b181f-9564-4405-8f3b-0b8c4bd25102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47361729-1df7-4084-8819-76e4b8e43a1e", "name": "network-vif-deleted", "tag": "81cd5932-3a95-43b6-86ae-902a62b744b9"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:12.450139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b0314912-3148-4015-89a6-99d3aff75690 req-6c4b181f-9564-4405-8f3b-0b8c4bd25102 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.454650 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b0314912-3148-4015-89a6-99d3aff75690 req-6c4b181f-9564-4405-8f3b-0b8c4bd25102 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.456154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b0314912-3148-4015-89a6-99d3aff75690 req-6c4b181f-9564-4405-8f3b-0b8c4bd25102 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.478733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-b0314912-3148-4015-89a6-99d3aff75690 req-6c4b181f-9564-4405-8f3b-0b8c4bd25102 service nova] Creating event network-vif-deleted:81cd5932-3a95-43b6-86ae-902a62b744b9 for instance 47361729-1df7-4084-8819-76e4b8e43a1e on hv-cinder-85426 Aug 29 21:32:12.485347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-b0314912-3148-4015-89a6-99d3aff75690 req-6c4b181f-9564-4405-8f3b-0b8c4bd25102 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.417422 Aug 29 21:32:12.486549 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 324/675] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:12.508416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:12.511598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:12.522710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.523202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.523635 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.524581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.525211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.525884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.646605 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:12.647765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:12.660775 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.661659 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.662435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.663599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.664264 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.665005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.708478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:12.719346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:12.723568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:12.723568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8c5a6bdf-b452-40a0-b0d1-12f600f3cf7b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1405 microversion: 2.20 time: 0.225869 Aug 29 21:32:12.723568 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 352/676] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:12 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:12.840683 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:12.857322 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ea8c2129-8d03-45bc-96ce-c1fb52f2df6a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1547 microversion: 2.1 time: 0.218618 Aug 29 21:32:12.858428 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 325/677] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:12 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1547 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:12.878701 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:12.879190 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:12.894911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.895541 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.896098 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:12.896973 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:12.897451 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:12.897954 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:13.007018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c5077974-1aeb-48a3-9298-c27dc0344566 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132204 Aug 29 21:32:13.018152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 353/678] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:32:12 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:13.300947 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:13.304812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:13.313980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:13.314717 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:13.315646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:13.317258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:13.318242 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:13.318961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:13.362950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:13.363854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:13.364581 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:13.365379 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'fault' on Instance uuid 47361729-1df7-4084-8819-76e4b8e43a1e {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:13.436540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:13.454917 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f80aae06-1d05-4576-804d-9bbc15bde774 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1334 microversion: 2.1 time: 0.162292 Aug 29 21:32:13.472305 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 326/679] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:13 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:13.747167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:13.748936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:13.755632 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:13.756158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:13.756811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:13.757765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:13.758236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:13.758809 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:14.034395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:14.050411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:14.052952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:14.054829 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0d73ac29-e2ec-4e72-99b8-41f208346f51 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1597 microversion: 2.20 time: 0.312687 Aug 29 21:32:14.066035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 354/680] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:13 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1597 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:14.082683 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:14.084335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:14.094415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:14.094958 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:14.095389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:14.096147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:14.096634 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:14.097109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:14.186928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dd9007e9-5a29-47fa-9364-1891f932c485 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109343 Aug 29 21:32:14.188645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 327/681] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Aug 29 21:32:14 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:32:14.483022 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:14.484192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:14.491927 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:14.494305 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:14.495690 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:14.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:14.499001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:14.500170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:14.562630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:14.563149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:14.564108 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:14.564864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'fault' on Instance uuid 47361729-1df7-4084-8819-76e4b8e43a1e {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:14.628848 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:14.637836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6f4e6869-679a-4ea0-940d-03f978db4cf5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 200 len: 1334 microversion: 2.1 time: 0.162336 Aug 29 21:32:14.644938 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 355/682] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:14 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 1334 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:14.653076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-ba3b5ed9-0c81-4e8d-914f-f3572e0fd37f req-0e112b94-41ab-4925-a062-603b107b5743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bd4734-3240-4f81-b09d-3579374dcf37", "tag": "1f7519bf-31a6-4fc4-a960-21b24ae8df99"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:14.673065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-ba3b5ed9-0c81-4e8d-914f-f3572e0fd37f req-0e112b94-41ab-4925-a062-603b107b5743 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:14.677289 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-ba3b5ed9-0c81-4e8d-914f-f3572e0fd37f req-0e112b94-41ab-4925-a062-603b107b5743 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:14.677289 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-ba3b5ed9-0c81-4e8d-914f-f3572e0fd37f req-0e112b94-41ab-4925-a062-603b107b5743 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:14.700353 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-ba3b5ed9-0c81-4e8d-914f-f3572e0fd37f req-0e112b94-41ab-4925-a062-603b107b5743 service nova] Creating event network-changed:1f7519bf-31a6-4fc4-a960-21b24ae8df99 for instance 14bd4734-3240-4f81-b09d-3579374dcf37 on hv-cinder-85426 Aug 29 21:32:14.707708 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-ba3b5ed9-0c81-4e8d-914f-f3572e0fd37f req-0e112b94-41ab-4925-a062-603b107b5743 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193664 Aug 29 21:32:14.709197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 328/683] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:15.663176 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:15.663798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 47361729-1df7-4084-8819-76e4b8e43a1e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:15.676788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:15.677286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:15.677726 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:15.678476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:15.678954 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:15.679394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:15.701759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] HTTP exception thrown: Instance 47361729-1df7-4084-8819-76e4b8e43a1e could not be found. Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Request method failure captured: Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e HTTP/1.1 Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VAKorWYiJaDKSSEZ11WWrQkfPVT8wxHn8T26g1yqqzyhW2JAhbu3_S1nxRmQ70ZuZqG6_BrQzX1ADV05SpV9EossnjrkiMPSBPoBmlFlWw93_0pmdc0oyC_0MObKokOavxNqNayYYo0Dos-E2Ev9T2uk4K-q6UuZQm-wM7864QaQ Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:32:15.704049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd7bb76694c2499895f24e611c644a27", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: b7e0a78238e94fa4a8209550c901a9a5 Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 47361729-1df7-4084-8819-76e4b8e43a1e could not be found. Aug 29 21:32:15.705884 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '47361729-1df7-4084-8819-76e4b8e43a1e'} Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47361729-1df7-4084-8819-76e4b8e43a1e could not be found. Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:32:15.706789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47361729-1df7-4084-8819-76e4b8e43a1e could not be found. Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47361729-1df7-4084-8819-76e4b8e43a1e could not be found. Aug 29 21:32:15.709491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:15.711224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Returning 404 to user: Instance 47361729-1df7-4084-8819-76e4b8e43a1e could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:32:15.711224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-62a1cb35-ff1a-4224-bb39-a31bbf490012 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e" status: 404 len: 111 microversion: 2.1 time: 0.051084 Aug 29 21:32:15.711224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 356/684] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:15 2022] GET /compute/v2.1/servers/47361729-1df7-4084-8819-76e4b8e43a1e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:32:15.717833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a8eadb70-421b-421e-975d-843931baa5b9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '.version_select at 0x7fc84019e310>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:15.880021 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a8eadb70-421b-421e-975d-843931baa5b9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604940027" status: 202 len: 0 microversion: 2.1 time: 0.166902 Aug 29 21:32:15.880605 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 329/685] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Aug 29 21:32:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604940027 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:32:16.192777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-ff2f4eb2-1381-4404-b15e-983ec46c87be req-9d4532a9-42d8-4114-a6d7-0dda094dc768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed516ef-b559-450d-b615-b95c82908ee2", "tag": "66c8e05e-f016-4ff0-8e7c-2e45a091431f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:16.214462 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ff2f4eb2-1381-4404-b15e-983ec46c87be req-9d4532a9-42d8-4114-a6d7-0dda094dc768 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:16.215334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ff2f4eb2-1381-4404-b15e-983ec46c87be req-9d4532a9-42d8-4114-a6d7-0dda094dc768 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:16.216164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ff2f4eb2-1381-4404-b15e-983ec46c87be req-9d4532a9-42d8-4114-a6d7-0dda094dc768 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:16.239760 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-ff2f4eb2-1381-4404-b15e-983ec46c87be req-9d4532a9-42d8-4114-a6d7-0dda094dc768 service nova] Creating event network-changed:66c8e05e-f016-4ff0-8e7c-2e45a091431f for instance 9ed516ef-b559-450d-b615-b95c82908ee2 on hv-cinder-85426 Aug 29 21:32:16.248708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-ff2f4eb2-1381-4404-b15e-983ec46c87be req-9d4532a9-42d8-4114-a6d7-0dda094dc768 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064022 Aug 29 21:32:16.253911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 357/686] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:19.793502 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:19.794111 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:19.806098 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:19.806642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:19.807085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:19.807797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:19.808297 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:19.808721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:19.840732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:32:19.844456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:20.237471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-829be958-a429-4d05-ac52-81647f2d3ea9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "DELETE /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 204 len: 0 microversion: 2.1 time: 0.447656 Aug 29 21:32:20.237471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 330/687] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:32:19 2022] DELETE /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:32:20.253449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:20.254657 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:20.267731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:20.268470 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:20.269157 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:20.273607 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:20.273607 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:20.273607 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:20.437613 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:20.448735 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d8aa8edf-91c1-4260-8157-5e734d1e5cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1505 microversion: 2.1 time: 0.204416 Aug 29 21:32:20.449792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 358/688] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:20 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:21.475222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:21.475836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:21.482857 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:21.483338 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:21.483776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:21.484510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:21.484967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:21.485389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:21.659315 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:21.668010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-05e70c0b-ddba-441c-aa86-b24fa28abd7e tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1505 microversion: 2.1 time: 0.198906 Aug 29 21:32:21.668642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 331/689] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:21 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:22.341282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cc66c77-3b18-4d48-997e-a6f8b02fda9d"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:22.343991 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:22.350790 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:22.351262 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:22.356226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:22.356226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:22.356226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:22.356226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:22.452961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Invalid volume: volume 5cc66c77-3b18-4d48-997e-a6f8b02fda9d is already attached to instances: 8776b21b-316e-4438-a12f-ee8aef1a85e4 Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: POST /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments HTTP/1.1 Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 74 Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:32:22.455019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {"volumeAttachment": {"volumeId": "5cc66c77-3b18-4d48-997e-a6f8b02fda9d"}} Aug 29 21:32:22.456594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Invalid volume: volume 5cc66c77-3b18-4d48-997e-a6f8b02fda9d is already attached to instances: 8776b21b-316e-4438-a12f-ee8aef1a85e4 Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'server_id': '8776b21b-316e-4438-a12f-ee8aef1a85e4', 'body': {'volumeAttachment': {'volumeId': '5cc66c77-3b18-4d48-997e-a6f8b02fda9d'}}} Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5cc66c77-3b18-4d48-997e-a6f8b02fda9d is already attached to instances: 8776b21b-316e-4438-a12f-ee8aef1a85e4 Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:22.457490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5cc66c77-3b18-4d48-997e-a6f8b02fda9d is already attached to instances: 8776b21b-316e-4438-a12f-ee8aef1a85e4 Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:22.458841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5cc66c77-3b18-4d48-997e-a6f8b02fda9d is already attached to instances: 8776b21b-316e-4438-a12f-ee8aef1a85e4 Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 400 to user: Invalid volume: volume 5cc66c77-3b18-4d48-997e-a6f8b02fda9d is already attached to instances: 8776b21b-316e-4438-a12f-ee8aef1a85e4 {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d6a241e3-19fe-4a98-84f9-f902dd381020 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119807 Aug 29 21:32:22.460319 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 359/690] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:32:22 2022] POST /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:32:22.525936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:22.526505 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:22.533851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:22.537659 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:22.537659 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:22.537659 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:22.537659 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:22.538271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:22.640363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-7284a421-274b-4d9c-90a3-3bf7bd16d4f4 req-fc814ecc-bc47-4a78-9b8c-7eddf6b47aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37678b50-656d-49b5-8f7a-5059a89f458d", "name": "network-vif-deleted", "tag": "97d85e67-a7e1-4cc9-a19b-75eb2eaacfe5"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:22.653823 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-7284a421-274b-4d9c-90a3-3bf7bd16d4f4 req-fc814ecc-bc47-4a78-9b8c-7eddf6b47aa4 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:22.654577 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-7284a421-274b-4d9c-90a3-3bf7bd16d4f4 req-fc814ecc-bc47-4a78-9b8c-7eddf6b47aa4 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:22.655141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-7284a421-274b-4d9c-90a3-3bf7bd16d4f4 req-fc814ecc-bc47-4a78-9b8c-7eddf6b47aa4 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:22.672134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-7284a421-274b-4d9c-90a3-3bf7bd16d4f4 req-fc814ecc-bc47-4a78-9b8c-7eddf6b47aa4 service nova] Creating event network-vif-deleted:97d85e67-a7e1-4cc9-a19b-75eb2eaacfe5 for instance 37678b50-656d-49b5-8f7a-5059a89f458d on hv-cinder-85426 Aug 29 21:32:22.683933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-7284a421-274b-4d9c-90a3-3bf7bd16d4f4 req-fc814ecc-bc47-4a78-9b8c-7eddf6b47aa4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041885 Aug 29 21:32:22.683933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 360/691] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:22.684637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'services' on Instance uuid 8776b21b-316e-4438-a12f-ee8aef1a85e4 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:22.701935 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:22.703831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:22.716112 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:22.716802 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:22.717162 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:22.718160 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:22.718626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:22.719065 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:22.796636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:22.800583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:22.805259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-68695060-fdbe-469b-999b-50b19a5f9f95 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1463 microversion: 2.1 time: 0.111077 Aug 29 21:32:22.805869 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 361/692] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:22 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1463 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:23.086169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3d0ae5b0-336f-4f55-91e3-0006f85f353e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments/5cc66c77-3b18-4d48-997e-a6f8b02fda9d" status: 202 len: 0 microversion: 2.1 time: 0.565344 Aug 29 21:32:23.087119 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 332/693] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:32:22 2022] DELETE /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments/5cc66c77-3b18-4d48-997e-a6f8b02fda9d => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:32:23.100436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:23.103915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:23.116755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:23.117458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:23.120738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:23.120738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:23.120738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:23.121017 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:23.160691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-89ec14bc-95ca-460f-9680-0b547d846016 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063089 Aug 29 21:32:23.160691 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 362/694] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:32:23 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:23.836172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:23.837377 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:23.845637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:23.846125 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:23.846667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:23.847589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:23.848202 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:23.848737 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:23.888607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:23.889218 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:23.889660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:23.890107 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'fault' on Instance uuid 37678b50-656d-49b5-8f7a-5059a89f458d {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:23.938239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:23.947778 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3ee4e395-dd64-4ac0-b39b-35aa7cd7459c tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 200 len: 1312 microversion: 2.1 time: 0.118102 Aug 29 21:32:23.948420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 333/695] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:23 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:24.170839 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:24.173332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:24.181627 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:24.182337 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:24.182892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:24.183618 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:24.184111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:24.184541 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:24.218577 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5e1b3fb2-ff16-4362-8932-e70e4b7c20c5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051938 Aug 29 21:32:24.221890 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 363/696] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:32:24 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:24.981933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:24.982524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 37678b50-656d-49b5-8f7a-5059a89f458d] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:24.989238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:24.989723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:24.990156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:24.990859 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:24.991312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:24.991733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.006990 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] HTTP exception thrown: Instance 37678b50-656d-49b5-8f7a-5059a89f458d could not be found. Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Request method failure captured: Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d HTTP/1.1 Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VAKorWYiJaDKSSEZ11WWrQkfPVT8wxHn8T26g1yqqzyhW2JAhbu3_S1nxRmQ70ZuZqG6_BrQzX1ADV05SpV9EossnjrkiMPSBPoBmlFlWw93_0pmdc0oyC_0MObKokOavxNqNayYYo0Dos-E2Ev9T2uk4K-q6UuZQm-wM7864QaQ Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:32:25.008788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd7bb76694c2499895f24e611c644a27", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: b7e0a78238e94fa4a8209550c901a9a5 Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 37678b50-656d-49b5-8f7a-5059a89f458d could not be found. Aug 29 21:32:25.011403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '37678b50-656d-49b5-8f7a-5059a89f458d'} Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37678b50-656d-49b5-8f7a-5059a89f458d could not be found. Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:32:25.012669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37678b50-656d-49b5-8f7a-5059a89f458d could not be found. Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37678b50-656d-49b5-8f7a-5059a89f458d could not be found. Aug 29 21:32:25.014390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:25.015728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Returning 404 to user: Instance 37678b50-656d-49b5-8f7a-5059a89f458d could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:32:25.015728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-969f6c6b-37d3-4eca-9733-1ac10284a29b tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d" status: 404 len: 111 microversion: 2.1 time: 0.032729 Aug 29 21:32:25.015728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 334/697] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:24 2022] GET /compute/v2.1/servers/37678b50-656d-49b5-8f7a-5059a89f458d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:32:25.023622 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:25.024406 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:25.027304 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:25.038076 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.043179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.043179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.043179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.043179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.043782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.070816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:32:25.231711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:25.234147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:25.240429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.240933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.241351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.242058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.242511 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.242931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.275561 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0c3673d4-5b47-4450-bc4a-bde92e61be4e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048545 Aug 29 21:32:25.276492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 335/698] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:32:25 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:32:25.350671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:25.351161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:25.358038 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.358517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.358953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.359658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.360133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.360551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.390769 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:32:25.515729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6fa473ea-6ca7-4d74-a306-59857ae5f8da tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "DELETE /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 204 len: 0 microversion: 2.1 time: 0.499809 Aug 29 21:32:25.516422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 364/699] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:32:25 2022] DELETE /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:32:25.527016 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:25.527722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:25.534147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.534634 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.535190 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.535910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.536385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.536808 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.683657 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:25.691486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ae545fca-6dfb-42fc-8fc7-3060ecc4033d tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.170112 Aug 29 21:32:25.693271 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 365/700] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:25 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:25.907991 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4337f24d-a750-4a97-bbb6-0710d2091da6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 204 len: 0 microversion: 2.1 time: 0.560621 Aug 29 21:32:25.908567 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 336/701] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:32:25 2022] DELETE /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:32:25.917031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:25.917640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:25.924169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.924775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.925212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:25.925956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:25.926405 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:25.926825 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:26.070180 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:26.079434 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2a493a6c-595f-457e-897c-892b9d29d5df tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1683 microversion: 2.1 time: 0.166139 Aug 29 21:32:26.080064 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 366/702] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:25 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:26.713889 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:26.714509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:26.721759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:26.722308 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:26.722721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:26.723421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:26.723876 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:26.724323 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:26.860726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:26.869161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-87976141-6deb-4127-ac89-fe56cf7cec74 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.159598 Aug 29 21:32:26.870271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 337/703] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:26 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:27.101068 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:27.101856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:27.109249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:27.109731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:27.110166 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:27.110863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:27.111313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:27.111732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:27.257678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:27.266108 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-335ff334-dc24-476c-b432-0986bc344357 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1683 microversion: 2.1 time: 0.168857 Aug 29 21:32:27.266685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 367/704] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:27 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:27.890809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:27.891582 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:27.898257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:27.898759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:27.899302 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:27.900242 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:27.900516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:27.900984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:28.044469 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:28.052954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0628a45a-2a59-488c-82e5-c95bdd35fc44 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.166129 Aug 29 21:32:28.053541 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 338/705] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:27 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:28.287854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:28.288510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:28.299289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:28.300224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:28.300752 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:28.301618 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:28.302235 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:28.302993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:28.469997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:28.479155 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-15a85ac3-092e-490d-b65a-bc72d141e1f7 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1683 microversion: 2.1 time: 0.194693 Aug 29 21:32:28.480058 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 368/706] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:28 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:29.075801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:29.076445 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:29.083171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:29.083654 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:29.084203 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:29.084917 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:29.085370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:29.085787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:29.224285 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:29.232847 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1849f7bd-1407-4bdf-920c-cdfbe36c3cd1 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1519 microversion: 2.1 time: 0.161059 Aug 29 21:32:29.233430 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 339/707] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:29 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:29.500965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:29.501644 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:29.508626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:29.509112 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:29.509538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:29.510739 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:29.511184 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:29.511595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:29.677886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:29.687056 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f24f4159-9321-4a7b-b29b-4be7e34cdf8c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1683 microversion: 2.1 time: 0.189813 Aug 29 21:32:29.687636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 369/708] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:29 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:30.255152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:30.256597 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:30.265576 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:30.266082 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:30.278783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:30.278783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:30.278783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:30.278783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:30.359764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-704b8e20-5906-439e-8ab2-4edb425a4307 req-9c212f08-b825-4476-8a62-a094190429c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b9b318-ba34-455a-90b9-4ff5619fa02e", "name": "network-vif-deleted", "tag": "9038f059-1399-4f98-9ce3-88cce7cf0565"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:30.370341 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-704b8e20-5906-439e-8ab2-4edb425a4307 req-9c212f08-b825-4476-8a62-a094190429c9 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:30.370926 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-704b8e20-5906-439e-8ab2-4edb425a4307 req-9c212f08-b825-4476-8a62-a094190429c9 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:30.371561 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-704b8e20-5906-439e-8ab2-4edb425a4307 req-9c212f08-b825-4476-8a62-a094190429c9 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:30.377460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:30.386095 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0676dd19-ab85-4d90-955b-eda500def5e9 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1477 microversion: 2.1 time: 0.135315 Aug 29 21:32:30.391508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-704b8e20-5906-439e-8ab2-4edb425a4307 req-9c212f08-b825-4476-8a62-a094190429c9 service nova] Creating event network-vif-deleted:9038f059-1399-4f98-9ce3-88cce7cf0565 for instance 28b9b318-ba34-455a-90b9-4ff5619fa02e on hv-cinder-85426 Aug 29 21:32:30.400114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 340/709] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:30 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1477 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:30.402210 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-704b8e20-5906-439e-8ab2-4edb425a4307 req-9c212f08-b825-4476-8a62-a094190429c9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045998 Aug 29 21:32:30.402993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 370/710] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:30.715811 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:30.720993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:30.729612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:30.730479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:30.731578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:30.732838 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:30.733941 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:30.734693 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:30.860515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:30.875900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-442d1b22-5bb8-4781-b15e-98cdbb67383d tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1615 microversion: 2.1 time: 0.168091 Aug 29 21:32:30.877161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 341/711] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:30 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1615 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:31.416583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:31.417737 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:31.431106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:31.432046 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:31.432854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:31.437368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:31.437368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:31.437368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:31.492379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:31.493233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:31.494036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:31.495346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lazy-loading 'fault' on Instance uuid 28b9b318-ba34-455a-90b9-4ff5619fa02e {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:31.565486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e0a78238e94fa4a8209550c901a9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7bb76694c2499895f24e611c644a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:31.574747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-919599c3-17de-409d-8ef0-f473f91a0ff5 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 200 len: 1312 microversion: 2.1 time: 0.167082 Aug 29 21:32:31.575345 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 371/712] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:31 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:31.919413 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:31.920467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:31.927604 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:31.928150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:31.928585 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:31.929301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:31.929818 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:31.930241 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:31.966821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:31.967389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:31.968123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:31.968580 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'fault' on Instance uuid 8776b21b-316e-4438-a12f-ee8aef1a85e4 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:32.029715 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:32.060946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e1dc5cc9-eeb8-467c-aea1-c0cd291da0ea tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 200 len: 1331 microversion: 2.1 time: 0.149639 Aug 29 21:32:32.062434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 342/713] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:31 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:32.421875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-04596bbe-9f77-4ba6-968a-262512bec3ce req-6f2c5358-c78c-43f0-92e4-1a074e9760ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8776b21b-316e-4438-a12f-ee8aef1a85e4", "name": "network-vif-deleted", "tag": "b44a2d3f-af24-48dd-823e-bdbfd82ce7a3"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:32.436175 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-04596bbe-9f77-4ba6-968a-262512bec3ce req-6f2c5358-c78c-43f0-92e4-1a074e9760ca service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:32.437085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-04596bbe-9f77-4ba6-968a-262512bec3ce req-6f2c5358-c78c-43f0-92e4-1a074e9760ca service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:32.437900 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-04596bbe-9f77-4ba6-968a-262512bec3ce req-6f2c5358-c78c-43f0-92e4-1a074e9760ca service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:32.454652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-04596bbe-9f77-4ba6-968a-262512bec3ce req-6f2c5358-c78c-43f0-92e4-1a074e9760ca service nova] Creating event network-vif-deleted:b44a2d3f-af24-48dd-823e-bdbfd82ce7a3 for instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 on hv-cinder-85426 Aug 29 21:32:32.460325 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-04596bbe-9f77-4ba6-968a-262512bec3ce req-6f2c5358-c78c-43f0-92e4-1a074e9760ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043857 Aug 29 21:32:32.460921 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 372/714] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:32.597970 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:32.598541 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] [instance: 28b9b318-ba34-455a-90b9-4ff5619fa02e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:32.604698 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:32.605216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:32.605653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:32.606350 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:32.606805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:32.607225 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:32.621746 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] HTTP exception thrown: Instance 28b9b318-ba34-455a-90b9-4ff5619fa02e could not be found. Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Request method failure captured: Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e HTTP/1.1 Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VAKorWYiJaDKSSEZ11WWrQkfPVT8wxHn8T26g1yqqzyhW2JAhbu3_S1nxRmQ70ZuZqG6_BrQzX1ADV05SpV9EossnjrkiMPSBPoBmlFlWw93_0pmdc0oyC_0MObKokOavxNqNayYYo0Dos-E2Ev9T2uk4K-q6UuZQm-wM7864QaQ Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:32:32.623383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd7bb76694c2499895f24e611c644a27", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd7bb76694c2499895f24e611c644a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: bd7bb76694c2499895f24e611c644a27 Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-462218989 Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: b7e0a78238e94fa4a8209550c901a9a5 Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-ServerRescueNegativeTestJSON-462218989-project Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 28b9b318-ba34-455a-90b9-4ff5619fa02e could not be found. Aug 29 21:32:32.624890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '28b9b318-ba34-455a-90b9-4ff5619fa02e'} Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b9b318-ba34-455a-90b9-4ff5619fa02e could not be found. Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:32:32.625703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b9b318-ba34-455a-90b9-4ff5619fa02e could not be found. Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b9b318-ba34-455a-90b9-4ff5619fa02e could not be found. Aug 29 21:32:32.627154 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:32:32.628444 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] Returning 404 to user: Instance 28b9b318-ba34-455a-90b9-4ff5619fa02e could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:32:32.628444 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ef30e236-5f7e-4d9a-8a44-40ea79330212 tempest-ServerRescueNegativeTestJSON-462218989 tempest-ServerRescueNegativeTestJSON-462218989-project] 10.222.0.65 "GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e" status: 404 len: 111 microversion: 2.1 time: 0.030982 Aug 29 21:32:32.628444 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 343/715] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:32 2022] GET /compute/v2.1/servers/28b9b318-ba34-455a-90b9-4ff5619fa02e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:32:33.093365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:33.094657 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:33.107072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:33.108008 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:33.108811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:33.110035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:33.111049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:33.111812 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:33.138752 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 HTTP/1.1 Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:32:33.141990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:32:33.143426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '8776b21b-316e-4438-a12f-ee8aef1a85e4'} Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:32:33.144246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:32:33.146020 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:33.147831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:32:33.147831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1d8b340d-3cab-4ecd-912b-fb2aef87e5fa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 404 len: 111 microversion: 2.1 time: 0.060747 Aug 29 21:32:33.147831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 373/716] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:33 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:32:33.162028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e53a29a0-e102-4f0c-a592-4c1abee1d7f5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '.version_select at 0x7fc83bf99160>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:33.186892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:33.282359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e53a29a0-e102-4f0c-a592-4c1abee1d7f5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898889167" status: 202 len: 0 microversion: 2.1 time: 0.128937 Aug 29 21:32:33.283270 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 344/717] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Aug 29 21:32:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898889167 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:32:34.995256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ecc7be84-15b7-4b13-88b0-0627e5301a79 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: .version_select at 0x7fc8400ce310>, body: {"keypair": {"name": "tempest-keypair-1554032532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOL7k5FEltP3fGBu7+Q01wfVxwpeSbTOHROF275ihkkjvbpD06rR1gpzMAO5TRWBAeTm/bghbuiLM7+3x+Qp3HrjwoDkbaOfuaq1TLZRbn8gbSw7+9KpbXeCpS9mZipnA=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:35.014263 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-ecc7be84-15b7-4b13-88b0-0627e5301a79 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:32:35.019395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-ecc7be84-15b7-4b13-88b0-0627e5301a79 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:32:35.157306 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ecc7be84-15b7-4b13-88b0-0627e5301a79 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169817 Aug 29 21:32:35.158081 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 374/718] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:32:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:39.023478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1051561765", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d52e082-ed9a-4937-bc0b-8b03e2527c03"}], "security_groups": [{"name": "tempest-securitygroup--871523328"}], "key_name": "tempest-keypair-1554032532", "user_data": "}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:39.193059 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] validate_networks() for [('5d52e082-ed9a-4937-bc0b-8b03e2527c03', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:32:39.824312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:32:39.825165 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:32:39.828406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:32:39.830026 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:32:39.830900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:32:39.848810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:39.849805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:39.855456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:39.855456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:39.855456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:39.855456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:39.868918 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:39.893702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:32:39.904576 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Getting quotas for user 68c15654f5a14850a1763a020c17c849 and project 8695633e1e2744b6b6554536f1109fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:32:39.927229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:32:39.930892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:32:40.185657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a7394b0e-6bc9-498e-a89c-f55fa6e23d77 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.167476 Aug 29 21:32:40.192348 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 345/719] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:32:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:32:40.219877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d08edec0-2528-496e-8827-04f4a7cfee8a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:40.221152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d08edec0-2528-496e-8827-04f4a7cfee8a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:40.325440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d08edec0-2528-496e-8827-04f4a7cfee8a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:40.340083 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d08edec0-2528-496e-8827-04f4a7cfee8a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1242 microversion: 2.1 time: 0.128676 Aug 29 21:32:40.341256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 375/720] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:40 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:41.367120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-46d5cafb-b13c-47ae-9674-f1368b96bd85 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:41.367936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-46d5cafb-b13c-47ae-9674-f1368b96bd85 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:41.457351 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-46d5cafb-b13c-47ae-9674-f1368b96bd85 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:41.469108 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-46d5cafb-b13c-47ae-9674-f1368b96bd85 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1242 microversion: 2.1 time: 0.105943 Aug 29 21:32:41.469696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 376/721] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:41 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:41.511392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6d6ffd5a-3950-4592-b55b-5e153e730ad0 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Action: 'create', calling method: .version_select at 0x7fc83bff9b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2000809213", "metadata": {"Type": "work"}}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:42.489903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:42.492474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:42.503105 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:42.503605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:42.504079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:42.505443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:42.513150 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:42.513150 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:42.558662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6d6ffd5a-3950-4592-b55b-5e153e730ad0 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.240086 Aug 29 21:32:42.566266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 346/722] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Aug 29 21:32:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1242 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:32:42.577052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ed65dc98-7819-459f-8632-a4d315d468fd tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Calling method '.version_select at 0x7fc8401e19d0>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:42.611661 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:42.623283 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e28251bc-fd6c-4a4e-8e3c-2a54dd93dc3f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1294 microversion: 2.1 time: 0.137352 Aug 29 21:32:42.624039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 377/723] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:42 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1294 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:42.638577 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ed65dc98-7819-459f-8632-a4d315d468fd tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa" status: 200 len: 353 microversion: 2.1 time: 0.066724 Aug 29 21:32:42.639168 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 347/724] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:32:42 2022] GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:43.653883 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-129ff759-cf47-4a4f-a50c-340882cdc1cd tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Calling method '.version_select at 0x7fc8400ce9d0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:43.659724 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:43.660670 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:43.677191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:43.677874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:43.678512 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:43.679270 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:43.679728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:43.680183 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:43.734643 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-129ff759-cf47-4a4f-a50c-340882cdc1cd tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa" status: 200 len: 354 microversion: 2.1 time: 0.084845 Aug 29 21:32:43.735640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 378/725] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:32:43 2022] GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:43.757214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-355aff6d-315b-4b00-a36d-960577257c91 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Calling method '.version_select at 0x7fc8401d7700>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:43.758891 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:43.775284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8ca49c57-fe7f-463d-8c26-4c59b5347cfa tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1312 microversion: 2.1 time: 0.119549 Aug 29 21:32:43.776706 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 348/726] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:43 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:43.822739 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-355aff6d-315b-4b00-a36d-960577257c91 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa" status: 200 len: 354 microversion: 2.1 time: 0.072392 Aug 29 21:32:43.823422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 379/727] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:32:43 2022] GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:43.845325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-25f22c02-e5c3-474f-a1be-df33834f40ca tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Calling method '.version_select at 0x7fc840267820>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:44.200144 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-25f22c02-e5c3-474f-a1be-df33834f40ca tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa" status: 202 len: 0 microversion: 2.1 time: 0.361142 Aug 29 21:32:44.200799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 349/728] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:32:43 2022] DELETE /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:32:44.213653 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e48a2d61-38b0-4540-b00f-0b3c5700f5b8 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Calling method '.version_select at 0x7fc8401490d0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:44.298133 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e48a2d61-38b0-4540-b00f-0b3c5700f5b8 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa" status: 200 len: 353 microversion: 2.1 time: 0.091593 Aug 29 21:32:44.298674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 380/729] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:32:44 2022] GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:44.814763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:44.816010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:44.829447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:44.830443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:44.831163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:44.832325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:44.833135 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:44.833905 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:45.111104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:45.123836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ffaa0e5e-71ed-472c-8f98-fecbe195005e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.318375 Aug 29 21:32:45.124831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 350/730] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:44 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:45.324018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3028a6b8-2010-43ee-847c-c9f23eec2ae0 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Calling method '.version_select at 0x7fc8400ce8b0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:45.368024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-3028a6b8-2010-43ee-847c-c9f23eec2ae0 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] HTTP exception thrown: Volume 01f3b197-459b-4146-bb4d-442e262c36fa could not be found. Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3028a6b8-2010-43ee-847c-c9f23eec2ae0 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Request method failure captured: Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa HTTP/1.1 Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTB5MWoDOC-sO_xcz--I5xAUQoovwk1L_ya-g1asp3O5EqyA_wJK8G5LTO1C445d2fqmmnwLmVCEmuUgy1YR3dfmvGkrRRwmxR2fYEpx79c6BPxqOZbK-EVVIybLfT64BVZpOWABEm5y35l57_hF4rWbuB6azkVivSxbfAS_NQfQEeQ Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: dbb0a73c46af4c3ea4258c0572d4ef7b Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-VolumesGetTestJSON-688561580 Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:32:45.370994 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbb0a73c46af4c3ea4258c0572d4ef7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbb0a73c46af4c3ea4258c0572d4ef7b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbb0a73c46af4c3ea4258c0572d4ef7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbb0a73c46af4c3ea4258c0572d4ef7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-VolumesGetTestJSON-688561580 Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: dbb0a73c46af4c3ea4258c0572d4ef7b Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-VolumesGetTestJSON-688561580 Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-VolumesGetTestJSON-688561580-project Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 4e6e38ca5a2b4c4f8129e0b67fe032f4 Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-VolumesGetTestJSON-688561580-project Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Volume 01f3b197-459b-4146-bb4d-442e262c36fa could not be found. Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '01f3b197-459b-4146-bb4d-442e262c36fa'} Aug 29 21:32:45.372685 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01f3b197-459b-4146-bb4d-442e262c36fa could not be found. (HTTP 404) (Request-ID: req-955b53d7-ee5d-4a90-9558-5d87d3a7b8ae) Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:45.373606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:32:45.375729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01f3b197-459b-4146-bb4d-442e262c36fa could not be found. Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:32:45.377097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01f3b197-459b-4146-bb4d-442e262c36fa could not be found. Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01f3b197-459b-4146-bb4d-442e262c36fa could not be found. Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3028a6b8-2010-43ee-847c-c9f23eec2ae0 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] Returning 404 to user: Volume 01f3b197-459b-4146-bb4d-442e262c36fa could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3028a6b8-2010-43ee-847c-c9f23eec2ae0 tempest-VolumesGetTestJSON-688561580 tempest-VolumesGetTestJSON-688561580-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa" status: 404 len: 109 microversion: 2.1 time: 0.054935 Aug 29 21:32:45.378486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 381/731] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:32:45 2022] GET /compute/v2.1/os-volumes/01f3b197-459b-4146-bb4d-442e262c36fa => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:32:45.755252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-7e938c42-9cb8-4385-b2b8-de1d80efc438 req-c4f73d35-c212-4064-9660-1d30df6ea2eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e3549b2-b215-4a30-b063-31786b24b795", "tag": "44144b9e-ff7d-4c65-b8c4-575d2da5e3cc"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:45.766125 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e938c42-9cb8-4385-b2b8-de1d80efc438 req-c4f73d35-c212-4064-9660-1d30df6ea2eb service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:45.766601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e938c42-9cb8-4385-b2b8-de1d80efc438 req-c4f73d35-c212-4064-9660-1d30df6ea2eb service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:45.767033 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-7e938c42-9cb8-4385-b2b8-de1d80efc438 req-c4f73d35-c212-4064-9660-1d30df6ea2eb service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:45.779915 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-7e938c42-9cb8-4385-b2b8-de1d80efc438 req-c4f73d35-c212-4064-9660-1d30df6ea2eb service nova] Creating event network-changed:44144b9e-ff7d-4c65-b8c4-575d2da5e3cc for instance 5e3549b2-b215-4a30-b063-31786b24b795 on hv-cinder-85426 Aug 29 21:32:45.786088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-7e938c42-9cb8-4385-b2b8-de1d80efc438 req-c4f73d35-c212-4064-9660-1d30df6ea2eb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034447 Aug 29 21:32:45.787078 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 351/732] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:46.150945 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:46.152370 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:46.166677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:46.167263 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:46.167832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:46.169069 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:46.169833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:46.170310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:46.330755 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:46.341754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e698b711-ea81-4997-bf99-1cd8cfcc7c1b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.198563 Aug 29 21:32:46.342880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 382/733] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:46 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:47.368115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:47.368846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:47.375489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:47.376180 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:47.376591 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:47.377302 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:47.377756 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:47.378173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:47.548515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:47.561168 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-429d09d8-23a9-4dd0-a664-c5854e5adaa1 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.197687 Aug 29 21:32:47.562234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 352/734] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:47 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:48.601022 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:48.601618 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:48.609586 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:48.610447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:48.611236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:48.612468 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:48.613402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:48.614342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:48.824278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:48.832998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-82728dc8-2d85-4429-98cb-48d7bfef049b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.241981 Aug 29 21:32:48.833635 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 383/735] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:48 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:49.866584 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:49.867459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:49.870483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:49.876398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:49.876906 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:49.877547 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:49.878366 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:49.878834 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:49.879267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:49.920399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=6 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:50.091524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:50.104235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d6ef5260-fc9e-4b6a-9328-bde22cc19cf5 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.241710 Aug 29 21:32:50.105062 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 353/736] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:49 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:50.872641 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:50.873241 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:50.879991 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:50.880478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:50.880911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:50.881630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:50.882083 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:50.882549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:50.909859 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7f260a07-2645-4dee-a0bc-7626073d6753 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/ips" status: 200 len: 144 microversion: 2.1 time: 0.041630 Aug 29 21:32:50.910461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 384/737] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:32:50 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:51.129854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:51.130644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:51.137702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:51.138197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:51.138625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:51.139330 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:51.139776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:51.140233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:51.296462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:51.308553 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-45b0b38e-1df0-44e3-b61d-826fbe0609e0 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.183002 Aug 29 21:32:51.309584 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 354/738] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:51 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:52.349452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:52.351052 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:52.361143 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=8 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.363797 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:52.364793 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:52.365564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:52.367014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:52.367880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:52.369094 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:52.471304 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:52.472629 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:52.480325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:52.480865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:52.481314 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:52.482235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:52.482702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:52.483478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:52.517036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f665ef00-6013-4299-ad63-463a17f86007 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/ips" status: 200 len: 152 microversion: 2.20 time: 0.051363 Aug 29 21:32:52.517629 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 355/739] 10.222.0.65 () {60 vars in 1289 bytes} [Mon Aug 29 21:32:52 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:32:52.577882 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:52.581995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.593543 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-19f611f7-0cd4-4c96-a13e-d186b3150183 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.252690 Aug 29 21:32:52.596366 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 385/740] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:52 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:52.840755 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba0f0976-d421-4b43-9c2c-18ec6ef3311a"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:52.851029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:52.851029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:52.851029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:52.851502 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:52.852077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:52.852538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:52.853490 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:53.628435 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:53.631666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:53.646055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:53.647078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:53.651503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:53.651503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:53.651503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:53.651503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:53.868826 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:53.878666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8b40c441-c509-4d8d-89ab-57233145504f tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.255506 Aug 29 21:32:53.879434 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 386/741] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:53 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:54.091278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a7788aae-3e1b-4b60-995b-099d6777004d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254342 Aug 29 21:32:54.092597 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 356/742] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:32:52 2022] POST /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments => generated 194 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:32:54.250594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-a6fe0a8c-cc70-4884-b561-2e659b13e99d req-56c15dfa-970c-47af-a0bb-4f3bca5296df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e3549b2-b215-4a30-b063-31786b24b795", "name": "network-vif-plugged", "status": "completed", "tag": "44144b9e-ff7d-4c65-b8c4-575d2da5e3cc"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:54.261719 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a6fe0a8c-cc70-4884-b561-2e659b13e99d req-56c15dfa-970c-47af-a0bb-4f3bca5296df service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:54.262294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a6fe0a8c-cc70-4884-b561-2e659b13e99d req-56c15dfa-970c-47af-a0bb-4f3bca5296df service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:54.262673 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-a6fe0a8c-cc70-4884-b561-2e659b13e99d req-56c15dfa-970c-47af-a0bb-4f3bca5296df service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:54.285064 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-a6fe0a8c-cc70-4884-b561-2e659b13e99d req-56c15dfa-970c-47af-a0bb-4f3bca5296df service nova] Creating event network-vif-plugged:44144b9e-ff7d-4c65-b8c4-575d2da5e3cc for instance 5e3549b2-b215-4a30-b063-31786b24b795 on hv-cinder-85426 Aug 29 21:32:54.293587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-a6fe0a8c-cc70-4884-b561-2e659b13e99d req-56c15dfa-970c-47af-a0bb-4f3bca5296df service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.411816 Aug 29 21:32:54.294724 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 387/743] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:54.915907 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:54.917288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:54.926509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:54.927005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:54.927447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:54.928472 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:54.929274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:54.929523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:54.995943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:55.002895 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:55.004030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:55.004510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:55.004944 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:55.005656 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:55.006106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:55.006528 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:55.039603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lazy-loading 'flavor' on Instance uuid 9ed516ef-b559-450d-b615-b95c82908ee2 {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:32:55.098826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:55.112472 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5c47acd8-673f-4924-b681-dd252537e096 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.204681 Aug 29 21:32:55.113387 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 357/744] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:54 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:32:55.847950 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-49dca8d0-e370-41ce-9e68-acc9fdd51c31 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/action" status: 202 len: 0 microversion: 2.20 time: 0.857276 Aug 29 21:32:55.848828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 388/745] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Aug 29 21:32:54 2022] POST /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:32:55.857774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:55.858349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:55.865450 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:55.866017 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:55.866510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:55.867210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:55.867670 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:55.868124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:56.089253 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:56.100764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:56.102545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:56.104706 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c0091a1a-36ad-40d8-9f80-e25a6f03ea7e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.250874 Aug 29 21:32:56.105259 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 358/746] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:55 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:32:56.150135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:56.150866 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:56.153123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:56.158539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:56.159030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:56.159524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:56.160278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:56.160768 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:56.161201 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:56.368811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:56.383417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2dbc1be7-35e1-476d-a53f-5bfc8b2046da tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1367 microversion: 2.1 time: 0.239530 Aug 29 21:32:56.384981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 389/747] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:56 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:57.129944 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:57.132543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:57.141611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:57.142354 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:57.143015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:57.143581 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:57.144331 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:57.144911 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:57.330423 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:57.346029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:57.352783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:57.352783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-acf723c7-b3e4-4368-8aad-9f1e3b1dc830 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.225174 Aug 29 21:32:57.352783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 359/748] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:57 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:57.408035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:57.408927 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:57.436141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:57.437300 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:57.437948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:57.438700 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:57.439168 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:57.439593 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:57.651137 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:57.661957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3092360a-579f-4072-a2f1-86eb926a574c tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1557 microversion: 2.1 time: 0.259951 Aug 29 21:32:57.663725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 390/749] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:32:57 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1557 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:57.690682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:57.691407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:57.699091 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:57.699615 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:57.700409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:57.701666 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:57.702483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:57.702959 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:57.798725 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1e498595-a194-4205-bce3-163ae84a55c6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111946 Aug 29 21:32:57.799749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 360/750] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Aug 29 21:32:57 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:58.389554 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:58.390660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:58.402099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:58.402931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:58.403921 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:58.405184 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:58.405899 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:58.406675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:58.708711 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:58.720779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:58.720779 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:58.721555 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9a514cc3-03ed-4b76-a48d-f475b3d29a4f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.339477 Aug 29 21:32:58.722550 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 391/751] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:58 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:59.122438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-11d488a9-142f-427a-9629-057f1a447361 req-b0b33761-6339-4aa2-94bc-f642dec8a887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e3549b2-b215-4a30-b063-31786b24b795", "tag": "44144b9e-ff7d-4c65-b8c4-575d2da5e3cc"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:32:59.133884 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-11d488a9-142f-427a-9629-057f1a447361 req-b0b33761-6339-4aa2-94bc-f642dec8a887 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:59.134995 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-11d488a9-142f-427a-9629-057f1a447361 req-b0b33761-6339-4aa2-94bc-f642dec8a887 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:59.135426 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-11d488a9-142f-427a-9629-057f1a447361 req-b0b33761-6339-4aa2-94bc-f642dec8a887 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:59.147854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-11d488a9-142f-427a-9629-057f1a447361 req-b0b33761-6339-4aa2-94bc-f642dec8a887 service nova] Creating event network-changed:44144b9e-ff7d-4c65-b8c4-575d2da5e3cc for instance 5e3549b2-b215-4a30-b063-31786b24b795 on hv-cinder-85426 Aug 29 21:32:59.154407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-11d488a9-142f-427a-9629-057f1a447361 req-b0b33761-6339-4aa2-94bc-f642dec8a887 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037814 Aug 29 21:32:59.155189 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 361/752] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:59.752280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:59.753093 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:32:59.770399 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:59.771444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:59.772434 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:59.773697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:59.775525 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:59.776704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:59.958376 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:59.973915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:59.976363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:32:59.978493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-847ae8f4-efd9-4e2f-ad35-49e5b2c84a99 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.230257 Aug 29 21:32:59.980211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 392/753] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:32:59 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:01.004001 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:01.004595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:01.011461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:01.012092 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:01.012538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:01.013328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:01.013809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:01.014211 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:01.171196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:01.185145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:01.187864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:01.190628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-befe5f2d-af84-4dff-b914-0350e4414ed4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.190954 Aug 29 21:33:01.191218 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 362/754] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:00 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:01.942524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:01.945184 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:01.952155 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:01.952595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:01.953041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:01.953756 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:01.954216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:01.954641 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:01.999921 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5e554614-8b53-4998-8715-01c031c1a60d tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061368 Aug 29 21:33:02.000600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 393/755] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:33:01 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:02.012001 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:02.012569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:02.019274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:02.019837 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:02.020563 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:02.021359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:02.021850 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:02.022283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:02.065008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-93830409-b688-41ca-9dd8-f73911464c47 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/ba0f0976-d421-4b43-9c2c-18ec6ef3311a" status: 200 len: 194 microversion: 2.1 time: 0.054911 Aug 29 21:33:02.065008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 363/756] 10.222.0.65 () {58 vars in 1413 bytes} [Mon Aug 29 21:33:02 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/ba0f0976-d421-4b43-9c2c-18ec6ef3311a => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:02.225571 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:02.228174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:02.233671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:02.234281 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:02.234949 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:02.235966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:02.236494 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:02.236957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:02.395201 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:02.399317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:02.401399 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:02.402595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-181527fd-73fd-4939-a171-b45bb775df87 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.180979 Aug 29 21:33:02.403144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 394/757] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:02 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:03.430573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:03.432085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:03.441267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:03.442003 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:03.442781 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:03.443997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:03.448103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:03.448103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:03.592222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:03.600833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:03.602273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:03.604111 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-74e93ec2-4c17-4c26-a457-2521f7a6ac5a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.181137 Aug 29 21:33:03.604677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 364/758] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:03 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:04.627422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:04.628092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:04.636944 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:04.637445 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:04.637877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:04.638574 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:04.639023 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:04.639442 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:04.788285 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:04.798076 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:04.799515 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:04.800722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b76ad039-4ec3-4584-b95e-b2e59529cbb0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.177303 Aug 29 21:33:04.801291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 395/759] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:04 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:05.826160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:05.826160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:05.832072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:05.832564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:05.833005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:05.833709 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:05.834170 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:05.834599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:05.970930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:05.982262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:05.983685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:05.984908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-00750ae5-0de1-4cfa-8df6-3881c1cb3a8a tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.164790 Aug 29 21:33:05.985479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 365/760] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:05 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:06.144623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f700ea7-c33a-445f-bd75-a5f8d8e9a80b"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:06.147090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:06.154810 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:06.155296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:06.155796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:06.156558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:06.157136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:06.157572 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:07.009772 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:07.010391 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:07.016987 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:07.017470 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:07.017911 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:07.018640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:07.019074 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:07.019498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:07.024010 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:07.153362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f833db05-4da9-42b8-92b7-b04e31b59593 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "POST /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012501 Aug 29 21:33:07.162104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:07.165948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 396/761] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:33:06 2022] POST /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments => generated 194 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:07.171848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:07.173707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:07.174998 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-79b9a249-5356-49d2-93c2-7c1272ee2020 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.169074 Aug 29 21:33:07.175736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 366/762] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:07 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:08.200186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:08.200810 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:08.206886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:08.207363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:08.207796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:08.208512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:08.208962 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:08.209384 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:08.355192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:08.368187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:08.368187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:08.368187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8d3f6bcc-f39a-4c5c-9208-cca3ca9d6e78 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.171641 Aug 29 21:33:08.368520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 397/763] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:08 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:09.391113 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:09.391915 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:09.394143 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:09.399590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:09.400102 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:09.400541 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:09.401266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:09.401757 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:09.402672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:09.547745 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:09.556647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:09.558493 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:09.559661 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3ec2e960-5f09-4e00-89bd-13912639b645 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.173687 Aug 29 21:33:09.560255 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 367/764] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:09 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:10.583519 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:10.584231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:10.592078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:10.594149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:10.594149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:10.594149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:10.594581 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:10.594875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:10.737794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:10.747183 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:10.748660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:10.749846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d16e2d72-085d-450b-b75e-f606d4b150aa tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.170941 Aug 29 21:33:10.750411 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 398/765] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:10 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:11.774550 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:11.775126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:11.782189 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:11.784156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:11.784156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:11.784156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:11.784601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:11.784907 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:11.921226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:11.929787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:11.937005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:11.937005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-aae20a8b-9255-40ea-a920-8666cae62b6c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.162608 Aug 29 21:33:11.937005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 368/766] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:11 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:12.956846 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:12.957464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:12.965234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:12.965949 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:12.966605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:12.967323 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:12.967772 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:12.968214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:13.128121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:13.133373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:13.137680 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:13.139125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:13.140335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a1dbff71-4eeb-4c9a-bc11-33c8991c513b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1743 microversion: 2.20 time: 0.187536 Aug 29 21:33:13.140972 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 399/767] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:12 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:14.165759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:14.166385 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:14.174041 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:14.174575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:14.175051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:14.175763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:14.176243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:14.176670 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:14.349164 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:14.358267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:14.359711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:14.360921 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-81eb8249-e919-4c78-90e5-a453773e02cb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1743 microversion: 2.20 time: 0.199296 Aug 29 21:33:14.361495 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 369/768] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:14 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:15.388976 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:15.389974 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:15.398885 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:15.399507 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:15.400133 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:15.401037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:15.404920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:15.404920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:15.737331 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-d6a3b945-dbca-4f89-a3a1-6138c42bf67c req-265f4ab4-fa12-45aa-a3a1-5ae3f28c8e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed516ef-b559-450d-b615-b95c82908ee2", "name": "network-vif-plugged", "status": "completed", "tag": "66c8e05e-f016-4ff0-8e7c-2e45a091431f"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:15.756691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d6a3b945-dbca-4f89-a3a1-6138c42bf67c req-265f4ab4-fa12-45aa-a3a1-5ae3f28c8e9a service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:15.757183 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d6a3b945-dbca-4f89-a3a1-6138c42bf67c req-265f4ab4-fa12-45aa-a3a1-5ae3f28c8e9a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:15.757802 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-d6a3b945-dbca-4f89-a3a1-6138c42bf67c req-265f4ab4-fa12-45aa-a3a1-5ae3f28c8e9a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:15.772685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-d6a3b945-dbca-4f89-a3a1-6138c42bf67c req-265f4ab4-fa12-45aa-a3a1-5ae3f28c8e9a service nova] Creating event network-vif-plugged:66c8e05e-f016-4ff0-8e7c-2e45a091431f for instance 9ed516ef-b559-450d-b615-b95c82908ee2 on hv-cinder-85426 Aug 29 21:33:15.778416 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-d6a3b945-dbca-4f89-a3a1-6138c42bf67c req-265f4ab4-fa12-45aa-a3a1-5ae3f28c8e9a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044264 Aug 29 21:33:15.778743 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 370/769] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:15.869014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:15.879953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:15.882065 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:15.883796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4c6acb2f-bbff-4b53-b9f9-c80e91e8cecc tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.502132 Aug 29 21:33:15.884655 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 400/770] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:15 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:15.899395 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:15.916977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:15.932623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:15.934160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:15.935278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:15.936946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:15.938286 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:15.939522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:15.997351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-aca5b3fe-86b1-4c6c-bc2e-61f29304a588 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.124685 Aug 29 21:33:15.997935 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 371/771] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:33:15 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:16.165703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:16.166202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:16.172993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:16.173593 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:16.174063 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:16.174863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:16.175484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:16.175943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:16.221840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9db047c6-9053-4dee-8732-75d8e964e3e7 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/ba0f0976-d421-4b43-9c2c-18ec6ef3311a" status: 200 len: 194 microversion: 2.1 time: 0.059848 Aug 29 21:33:16.230492 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 401/772] 10.222.0.65 () {58 vars in 1413 bytes} [Mon Aug 29 21:33:16 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/ba0f0976-d421-4b43-9c2c-18ec6ef3311a => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:16.238958 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:16.240162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:16.250429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:16.251484 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:16.252387 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:16.253814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:16.254948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:16.255854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:16.411558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lazy-loading 'services' on Instance uuid 14bd4734-3240-4f81-b09d-3579374dcf37 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:33:16.674325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-df03fbd3-a92a-45a3-b6b8-edff5766997e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/ba0f0976-d421-4b43-9c2c-18ec6ef3311a" status: 202 len: 0 microversion: 2.1 time: 0.441828 Aug 29 21:33:16.674939 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 372/773] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:33:16 2022] DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/ba0f0976-d421-4b43-9c2c-18ec6ef3311a => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:33:16.936610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:16.938097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:16.946106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:16.947019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:16.947488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:16.954114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:16.954114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:16.954114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:17.187783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:17.197405 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:17.200837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:17.203654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6740232a-e4b8-4e6d-a0da-b4bf57328394 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.272268 Aug 29 21:33:17.204815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 402/774] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:16 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:18.229969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:18.231017 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:18.241443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:18.242147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:18.242927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:18.243735 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:18.244410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:18.245257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:18.438703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:18.450743 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:18.452589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:18.453985 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-32804dfc-f048-47a6-a86a-58b38859e4f2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.229108 Aug 29 21:33:18.454710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 373/775] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:18 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:18.935421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:18.936016 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:18.943670 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:18.944281 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:18.944791 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:18.945512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:18.945970 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:18.946400 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:18.986572 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1035b177-e3b1-429d-af9f-9baa88fb5c38 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/3f700ea7-c33a-445f-bd75-a5f8d8e9a80b" status: 200 len: 194 microversion: 2.1 time: 0.055632 Aug 29 21:33:18.987320 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 403/776] 10.222.0.65 () {58 vars in 1413 bytes} [Mon Aug 29 21:33:18 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/3f700ea7-c33a-445f-bd75-a5f8d8e9a80b => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:18.998711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:18.999246 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:19.005360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:19.005846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:19.006280 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:19.006993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:19.007471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:19.007910 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:19.098647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lazy-loading 'services' on Instance uuid 14bd4734-3240-4f81-b09d-3579374dcf37 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:33:19.477359 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:19.477830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:19.484627 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:19.485101 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:19.486684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:19.486684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:19.486684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:19.487078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:19.642833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:19.655420 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:19.657815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:19.659708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-576db69c-a364-48fa-9f70-25d1e8a4422b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.186335 Aug 29 21:33:19.660863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 404/777] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:19 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:19.727107 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c46f0472-71ce-4d28-96d7-7eef6005d7c1 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/3f700ea7-c33a-445f-bd75-a5f8d8e9a80b" status: 202 len: 0 microversion: 2.1 time: 0.732322 Aug 29 21:33:19.728118 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 374/778] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:33:18 2022] DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments/3f700ea7-c33a-445f-bd75-a5f8d8e9a80b => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:33:20.687696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:20.688478 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:20.695783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:20.696307 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:20.696738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:20.697435 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:20.697938 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:20.700798 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:20.927382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:20.937549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:20.939658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:20.941166 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1acbef44-abcc-4b1e-acc1-cdfc9dbd9e60 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.257644 Aug 29 21:33:20.941946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 405/779] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:20 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:20.972152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:20.975083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:20.982373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:20.983104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:20.983540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:20.984274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:20.984907 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:20.985496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.037774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a13cf26a-8a8e-49a4-af5d-8f65f6ba051c tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070628 Aug 29 21:33:21.040837 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 375/780] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:33:20 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:33:21.181497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:21.184317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:21.190689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.191204 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.191710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.192517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.193041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.193557 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.229818 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ff703b9d-e3ab-4b7e-9f4a-5b315fa799d5 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052148 Aug 29 21:33:21.238860 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 406/781] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:33:21 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:33:21.299477 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:21.300438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:21.308220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.308988 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.309731 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.310643 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.311096 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.311519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.345445 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:33:21.852418 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b30ab72e-c131-449e-9dfd-e28d7d34e044 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 204 len: 0 microversion: 2.1 time: 0.556427 Aug 29 21:33:21.856120 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 376/782] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:33:21 2022] DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:33:21.870272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:21.872003 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:21.889080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.889906 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.890555 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.891389 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.891937 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.892421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.968464 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:21.969919 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:21.985501 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.991043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.991043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.991043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.991043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.997124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:22.153885 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:22.162569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5c4aa565-d910-490e-9d7f-f7401e063545 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1671 microversion: 2.1 time: 0.301734 Aug 29 21:33:22.163222 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 407/783] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:21 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:22.268936 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:22.277759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:22.279266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:22.280592 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-88e446f2-e8b5-4484-9820-bb2d26fa6163 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.317292 Aug 29 21:33:22.297206 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 377/784] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:21 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:23.184732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:23.185369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:23.192198 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:23.192826 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:23.193300 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:23.194009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:23.194497 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:23.195089 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:23.302525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:23.303114 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:23.309846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:23.310327 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:23.310765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:23.311465 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:23.311933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:23.312361 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:23.333603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:23.343360 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-974bb772-8eeb-433b-bbd3-2994d503ae52 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1671 microversion: 2.1 time: 0.162138 Aug 29 21:33:23.343360 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 408/785] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:23 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:23.461078 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:23.470557 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:23.472020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:23.473229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7f7d4943-a558-4bf2-8587-0c39d2cbb30b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.174590 Aug 29 21:33:23.473859 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 378/786] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:23 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:24.365375 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:24.366671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:24.377575 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:24.380413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:24.380413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:24.380413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:24.380413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:24.381140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:24.498689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:24.501426 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:24.522412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:24.525292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:24.529343 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:24.531086 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:24.531770 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:24.532373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:24.567820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:24.583033 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ca328adc-fb91-4787-aa69-8f1112e663db tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1671 microversion: 2.1 time: 0.222018 Aug 29 21:33:24.583621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 409/787] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:24 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:24.875498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:24.884545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:24.893545 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:24.894894 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-96917b8d-fe0e-463e-92ec-d008b2891be1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.400081 Aug 29 21:33:24.908705 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 379/788] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:24 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:25.049661 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-33bcd298-25c3-4194-bd86-fe5881d42eeb req-ab613069-a1ce-4693-afb1-ba6584604594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bd4734-3240-4f81-b09d-3579374dcf37", "name": "network-vif-deleted", "tag": "1f7519bf-31a6-4fc4-a960-21b24ae8df99"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:25.081629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-33bcd298-25c3-4194-bd86-fe5881d42eeb req-ab613069-a1ce-4693-afb1-ba6584604594 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:25.081629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-33bcd298-25c3-4194-bd86-fe5881d42eeb req-ab613069-a1ce-4693-afb1-ba6584604594 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:25.081629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-33bcd298-25c3-4194-bd86-fe5881d42eeb req-ab613069-a1ce-4693-afb1-ba6584604594 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:25.128538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-33bcd298-25c3-4194-bd86-fe5881d42eeb req-ab613069-a1ce-4693-afb1-ba6584604594 service nova] Creating event network-vif-deleted:1f7519bf-31a6-4fc4-a960-21b24ae8df99 for instance 14bd4734-3240-4f81-b09d-3579374dcf37 on hv-cinder-85426 Aug 29 21:33:25.141428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-33bcd298-25c3-4194-bd86-fe5881d42eeb req-ab613069-a1ce-4693-afb1-ba6584604594 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097368 Aug 29 21:33:25.142034 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 410/789] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:25.605742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:25.607127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:25.615288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:25.616131 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:25.621812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:25.625628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:25.626134 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:25.626653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:25.682773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:25.708732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:25.709291 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:25.710005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:25.710698 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lazy-loading 'fault' on Instance uuid 14bd4734-3240-4f81-b09d-3579374dcf37 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:33:25.789920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c5edb153624912b87d61dd7ad5e4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d35a885c494e11b42f556554f3698b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:25.803784 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-63a482d9-91c1-4d21-8b3e-69dff2caecaf tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 200 len: 1326 microversion: 2.1 time: 0.202584 Aug 29 21:33:25.804976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 380/790] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:25 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 1326 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:25.932832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:25.934139 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:25.945405 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:25.946678 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:25.947533 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:25.949421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:25.950060 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:25.951121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:26.226714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:26.236225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:26.237899 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:26.239017 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-413bd62a-b7ee-4f4d-bb31-de7fec01919f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.317100 Aug 29 21:33:26.240140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 411/791] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:25 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:26.844225 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:26.845789 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:26.853020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:26.853778 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:26.855107 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:26.855826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:26.856309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:26.856933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:26.872143 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] HTTP exception thrown: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Request method failure captured: Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 HTTP/1.1 Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8YVQOS1Lri69Wufc5zEm_DiPcCKVM1yJmp_eT1AS3fi26FOjFSOKlqdETUu-igl9Dj8RJNbmQiddSZwnrURn-IMpw9BxRt7Xe4UHO4DrjgGL_oRvKf3la9gFU47LjWMOjxX9Gb8uFDde3XTyQ8uu-tEFoRzH-FMioNBhG5cYdJRC0 Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:33:26.873817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8d35a885c494e11b42f556554f3698b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: d3c5edb153624912b87d61dd7ad5e4f3 Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:26.875568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '14bd4734-3240-4f81-b09d-3579374dcf37'} Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:26.876551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:26.878104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:26.880959 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Returning 404 to user: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:26.882025 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ebd227ba-885c-4881-9949-e3edd2bdda03 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 404 len: 111 microversion: 2.1 time: 0.044885 Aug 29 21:33:26.891608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a5cbaad0-36e0-4d79-a915-0d6317e6f33b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '.version_select at 0x7fc84017b040>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:26.897586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 381/792] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:26 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:27.019213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a5cbaad0-36e0-4d79-a915-0d6317e6f33b tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964879610" status: 202 len: 0 microversion: 2.1 time: 0.131215 Aug 29 21:33:27.024339 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 412/793] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Aug 29 21:33:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964879610 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:33:27.282102 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:27.282924 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:27.289890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:27.290601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:27.291070 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:27.291807 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:27.292351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:27.292851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:27.446610 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:27.456503 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:27.458491 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:27.459808 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a538ebf6-9de6-4d70-8e3c-4c7393b39f64 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.182102 Aug 29 21:33:27.460439 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 382/794] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:27 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:28.489464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:28.490950 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:28.504604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:28.516990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:28.520762 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:28.521340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:28.522483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:28.523078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:28.523649 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:28.828429 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:28.839786 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:28.841746 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:28.844238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2f1847f8-f621-43a3-90d9-41eb69287ecf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.362114 Aug 29 21:33:28.845347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 413/795] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:28 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:29.871520 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:29.872467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:29.879920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:29.880405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:29.880993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:29.881533 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:29.882023 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:29.882456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:30.026044 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:30.034567 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:30.036128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:30.037517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-346894f5-de7e-41e9-b929-c3595bbcdbfb tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1738 microversion: 2.20 time: 0.170684 Aug 29 21:33:30.038241 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 383/796] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:29 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:31.063149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:31.063595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:31.070674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:31.071163 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:31.071602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:31.072340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:31.072793 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:31.073888 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:31.237424 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:31.246436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:31.248084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:31.249369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-13dec13b-c6b3-4936-95dc-2927b7d27b95 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1720 microversion: 2.20 time: 0.191289 Aug 29 21:33:31.249946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 414/797] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:31 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:31.635121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:31.635661 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:31.643148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:31.643631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:31.644099 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:31.644805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:31.645256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:31.645677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:31.818407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] HTTP exception thrown: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Request method failure captured: Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 HTTP/1.1 Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8YVQOS1Lri69Wufc5zEm_DiPcCKVM1yJmp_eT1AS3fi26FOjFSOKlqdETUu-igl9Dj8RJNbmQiddSZwnrURn-IMpw9BxRt7Xe4UHO4DrjgGL_oRvKf3la9gFU47LjWMOjxX9Gb8uFDde3XTyQ8uu-tEFoRzH-FMioNBhG5cYdJRC0 Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:33:31.820054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8d35a885c494e11b42f556554f3698b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: d3c5edb153624912b87d61dd7ad5e4f3 Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.821780 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '14bd4734-3240-4f81-b09d-3579374dcf37'} Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:31.822686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.824295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.825835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Returning 404 to user: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:31.825835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b8e4606f-06b0-4e2f-a075-ce630af1925e tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 404 len: 111 microversion: 2.1 time: 0.190480 Aug 29 21:33:31.825835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 384/798] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:33:31 2022] DELETE /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:31.830102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:31.830731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 14bd4734-3240-4f81-b09d-3579374dcf37] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:31.837759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:31.838472 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:31.839310 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:31.840347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:31.840565 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:31.840985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:31.855594 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] HTTP exception thrown: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Request method failure captured: Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 HTTP/1.1 Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8YVQOS1Lri69Wufc5zEm_DiPcCKVM1yJmp_eT1AS3fi26FOjFSOKlqdETUu-igl9Dj8RJNbmQiddSZwnrURn-IMpw9BxRt7Xe4UHO4DrjgGL_oRvKf3la9gFU47LjWMOjxX9Gb8uFDde3XTyQ8uu-tEFoRzH-FMioNBhG5cYdJRC0 Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:33:31.857362 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8d35a885c494e11b42f556554f3698b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: d3c5edb153624912b87d61dd7ad5e4f3 Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.859004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '14bd4734-3240-4f81-b09d-3579374dcf37'} Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:31.859951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. Aug 29 21:33:31.861332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:31.862815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Returning 404 to user: Instance 14bd4734-3240-4f81-b09d-3579374dcf37 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:31.862815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9684057c-1f98-4ad2-899c-b127c8d6ba0a tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37" status: 404 len: 111 microversion: 2.1 time: 0.032568 Aug 29 21:33:31.862815 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 415/799] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:31 2022] GET /compute/v2.1/servers/14bd4734-3240-4f81-b09d-3579374dcf37 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:32.275284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:32.276065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:32.284567 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:32.285056 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:32.285881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:32.288126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:32.289070 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:32.289783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:32.468800 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:32.478216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:32.478719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:32.479874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0267fb6f-c9d2-4571-84ca-d872cfb610ec tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1720 microversion: 2.20 time: 0.210454 Aug 29 21:33:32.480431 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 385/800] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:32 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:33.321610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:33.322238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:33.328589 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.329087 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.329548 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.330258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.330715 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.331139 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.346429 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] HTTP exception thrown: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Request method failure captured: Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: DELETE /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb HTTP/1.1 Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8YVQOS1Lri69Wufc5zEm_DiPcCKVM1yJmp_eT1AS3fi26FOjFSOKlqdETUu-igl9Dj8RJNbmQiddSZwnrURn-IMpw9BxRt7Xe4UHO4DrjgGL_oRvKf3la9gFU47LjWMOjxX9Gb8uFDde3XTyQ8uu-tEFoRzH-FMioNBhG5cYdJRC0 Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:33:33.348103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8d35a885c494e11b42f556554f3698b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: d3c5edb153624912b87d61dd7ad5e4f3 Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.350858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '528c748a-ba74-44e6-b1a7-84ab068acfcb'} Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:33.352377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.355256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.357024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Returning 404 to user: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:33.357024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-67026b16-a006-4cd4-b3f6-8ddf0de09ca2 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "DELETE /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 404 len: 111 microversion: 2.1 time: 0.032929 Aug 29 21:33:33.357024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 416/801] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:33:33 2022] DELETE /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:33.359522 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:33.360162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] [instance: 528c748a-ba74-44e6-b1a7-84ab068acfcb] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:33.368235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.373742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.373742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.373742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.373742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.374229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.386738 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] HTTP exception thrown: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Request method failure captured: Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb HTTP/1.1 Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8YVQOS1Lri69Wufc5zEm_DiPcCKVM1yJmp_eT1AS3fi26FOjFSOKlqdETUu-igl9Dj8RJNbmQiddSZwnrURn-IMpw9BxRt7Xe4UHO4DrjgGL_oRvKf3la9gFU47LjWMOjxX9Gb8uFDde3XTyQ8uu-tEFoRzH-FMioNBhG5cYdJRC0 Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:33:33.388462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8d35a885c494e11b42f556554f3698b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8d35a885c494e11b42f556554f3698b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: d8d35a885c494e11b42f556554f3698b Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1181708457 Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: d3c5edb153624912b87d61dd7ad5e4f3 Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeTestJSON-1181708457-project Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.390546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '528c748a-ba74-44e6-b1a7-84ab068acfcb'} Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:33.391273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. Aug 29 21:33:33.392809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:33:33.394073 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] Returning 404 to user: Instance 528c748a-ba74-44e6-b1a7-84ab068acfcb could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:33.394073 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1dcbdb38-7bed-447c-801a-cf1861de5d13 tempest-AttachVolumeTestJSON-1181708457 tempest-AttachVolumeTestJSON-1181708457-project] 10.222.0.65 "GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb" status: 404 len: 111 microversion: 2.1 time: 0.034654 Aug 29 21:33:33.394073 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 386/802] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:33 2022] GET /compute/v2.1/servers/528c748a-ba74-44e6-b1a7-84ab068acfcb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:33.504980 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:33.505968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:33.513623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.514459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.515206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.516476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.517121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.517705 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.694858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:33.705543 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:33.707521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:33.708817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-eb63651e-5d74-4b7e-9076-123db71389df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1723 microversion: 2.20 time: 0.208576 Aug 29 21:33:33.709461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 417/803] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:33 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:33.738030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6453cbdd-d686-4abc-8ad7-b56136f69971"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:33.744566 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:33.750335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-c6500653-ec79-4f2d-9c65-63a8b3a939cf req-d8a5b3d4-7e9e-4158-b1b1-e1876370668a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed516ef-b559-450d-b615-b95c82908ee2", "name": "network-vif-unplugged", "status": "completed", "tag": "66c8e05e-f016-4ff0-8e7c-2e45a091431f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:33.759447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.760282 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.760914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.761398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c6500653-ec79-4f2d-9c65-63a8b3a939cf req-d8a5b3d4-7e9e-4158-b1b1-e1876370668a service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.761616 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:33.761878 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c6500653-ec79-4f2d-9c65-63a8b3a939cf req-d8a5b3d4-7e9e-4158-b1b1-e1876370668a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.762311 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c6500653-ec79-4f2d-9c65-63a8b3a939cf req-d8a5b3d4-7e9e-4158-b1b1-e1876370668a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.762656 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:33.763075 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:33.774500 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.compute.server_external_events [req-c6500653-ec79-4f2d-9c65-63a8b3a939cf req-d8a5b3d4-7e9e-4158-b1b1-e1876370668a service nova] Unable to find a host for instance 9ed516ef-b559-450d-b615-b95c82908ee2. Dropping event network-vif-unplugged {{(pid=121558) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 21:33:33.775510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-c6500653-ec79-4f2d-9c65-63a8b3a939cf req-d8a5b3d4-7e9e-4158-b1b1-e1876370668a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033117 Aug 29 21:33:33.776648 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 418/804] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 21:33:35.159747 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-96c07f26-bf80-4766-bfc7-cd373c116ff7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.426906 Aug 29 21:33:35.166373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 387/805] 10.222.0.65 () {62 vars in 1364 bytes} [Mon Aug 29 21:33:33 2022] POST /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-volume_attachments => generated 188 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:33:35.310045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:35.310623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:35.317172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:35.317660 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:35.318099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:35.318803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:35.319256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:35.319682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:35.412082 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:36.263044 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3b789f6c-b38f-4dc4-87ee-9a36b5a167ee tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-volume_attachments/6453cbdd-d686-4abc-8ad7-b56136f69971" status: 202 len: 0 microversion: 2.20 time: 0.957364 Aug 29 21:33:36.266898 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 419/806] 10.222.0.65 () {60 vars in 1457 bytes} [Mon Aug 29 21:33:35 2022] DELETE /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-volume_attachments/6453cbdd-d686-4abc-8ad7-b56136f69971 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:33:36.348011 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:36.351921 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:36.356450 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:36.357459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:36.358934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:36.360320 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:36.361473 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:36.362095 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:36.415241 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121559) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:33:36.978824 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:36.979841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:36.994308 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:36.995472 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:36.996504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:37.004453 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:37.006083 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:37.007048 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:37.032760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-37187f11-9d76-4b97-937b-2f972e766a66 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "POST /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/action" status: 202 len: 0 microversion: 2.20 time: 0.689338 Aug 29 21:33:37.038712 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 388/807] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Aug 29 21:33:36 2022] POST /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:33:37.060335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:37.061824 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:37.063192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4f25f7bd-ea3c-456e-bb68-3281721dd0bf tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/ips" status: 200 len: 150 microversion: 2.1 time: 0.099424 Aug 29 21:33:37.070747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 420/808] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:33:36 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/ips => generated 150 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:37.080649 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:37.081102 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:37.081675 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:37.082628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:37.084119 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:37.084741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:37.328859 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:37.348390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:37.350159 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:37.351491 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0c8609ab-0762-4e03-aea3-c8db05d735bd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1671 microversion: 2.20 time: 0.306642 Aug 29 21:33:37.367635 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 389/809] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:37 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1671 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:38.379365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:38.381343 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:38.389104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:38.389688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:38.390190 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:38.391145 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:38.391738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:38.392287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:38.718630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:38.740719 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:38.745418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:38.749426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fbaf86ac-e3f6-49ad-adae-eaa9eb32139b tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1671 microversion: 2.20 time: 0.376507 Aug 29 21:33:38.750671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 421/810] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:38 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1671 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:39.016640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d975cefa-4a49-4ed1-abf0-b42ad0b75b97"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:39.019214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:39.026091 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:39.026578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:39.027014 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:39.027714 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:39.028213 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:39.028732 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:39.781715 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:39.783185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:39.790532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:39.791120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:39.792339 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:39.793240 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:39.794313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:39.794747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:40.011438 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:40.030080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:40.031649 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:40.034074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e9c4be34-eed2-4257-8fe0-52cde2a883f4 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1671 microversion: 2.20 time: 0.256254 Aug 29 21:33:40.035503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 422/811] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:39 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:40.441274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2adf8a87-1c19-4705-a13f-4588585aa461 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "POST /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.427953 Aug 29 21:33:40.442596 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 390/812] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:33:39 2022] POST /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments => generated 194 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:41.063496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:41.064062 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:41.071313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:41.072086 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:41.081357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:41.081357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:41.081357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:41.081357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:41.235597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:41.245803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:41.256017 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:41.256017 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3a2a7ee7-51e5-42c6-91fe-e45e5d4080d0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.194013 Aug 29 21:33:41.256017 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 423/813] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:41 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:42.279393 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:42.280200 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:42.282399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:42.316446 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:42.320480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:42.321182 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:42.322252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:42.330245 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:42.330245 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:42.571077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:42.581060 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:42.584407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:42.584407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f5ddfe24-3b45-4564-9800-ad72e59b1d9f tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.310068 Aug 29 21:33:42.584953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 391/814] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:42 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:43.610110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:43.611028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:43.621139 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:43.623675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:43.623675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:43.624431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:43.625344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:43.625776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:43.885925 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:43.893725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:43.897808 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:43.899934 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-32187c1f-c02b-4270-ac62-e376de744eb2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.294253 Aug 29 21:33:43.902437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 424/815] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:43 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:43.970660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-29f18e32-a65d-45ba-baa6-957a49c31636 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc84014f3a0>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:44.091628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-29f18e32-a65d-45ba-baa6-957a49c31636 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/5c01f221-0068-4fc7-89e9-a72689336de7" status: 200 len: 351 microversion: 2.1 time: 0.126102 Aug 29 21:33:44.092640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 392/816] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:43 2022] GET /compute/v2.1/os-volumes/5c01f221-0068-4fc7-89e9-a72689336de7 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:44.964054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:44.964054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:44.964054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:44.964054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:44.965423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:44.965423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:44.965423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:44.965423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:45.163387 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:45.178778 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:45.182847 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:45.185465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5e0a7e0a-52dd-4a74-9ffd-be8776386bdf tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.247565 Aug 29 21:33:45.192133 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 425/817] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:44 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:46.223384 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.224220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:46.240298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:46.243599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:46.244148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:46.247748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:46.248630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:46.249049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:46.461140 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:46.480126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:46.484520 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:46.487061 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0d3f47a3-342f-46f6-908d-96b20fbe98df tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.269483 Aug 29 21:33:46.491215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 393/818] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:46.555731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-58786642-ca9b-4d4a-9d78-0ecfa01e903b tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc840100e50>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.664203 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-58786642-ca9b-4d4a-9d78-0ecfa01e903b tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/bf9c3b3b-5c3e-49bf-a47c-8ed22e884b63" status: 200 len: 350 microversion: 2.1 time: 0.117296 Aug 29 21:33:46.664773 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 426/819] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/os-volumes/bf9c3b3b-5c3e-49bf-a47c-8ed22e884b63 => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:47.527302 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:47.529489 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:47.543013 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:47.544188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:47.545200 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:47.546700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:47.547687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:47.549515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:47.907533 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:47.913711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:47.924821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:47.928710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:47.931332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8e1b3e8a-cde2-4efd-a320-2b264c14e4c7 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.411367 Aug 29 21:33:47.932968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 394/820] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:47 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:48.864023 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b7ed9424-a539-4b49-8add-40a8f24f0047 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc843b0e550>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:48.962611 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b7ed9424-a539-4b49-8add-40a8f24f0047 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/baeb632e-0952-4c1e-8960-845f27f3a107" status: 200 len: 351 microversion: 2.1 time: 0.104728 Aug 29 21:33:48.979309 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 427/821] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:48 2022] GET /compute/v2.1/os-volumes/baeb632e-0952-4c1e-8960-845f27f3a107 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:48.980243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:48.982339 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:48.994263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:48.995595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:48.996575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:48.996788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-57dbbde2-813f-43e0-8c5d-114874994f7f tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc843b0ef70>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:48.999363 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:49.000437 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:49.001106 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:49.164703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-57dbbde2-813f-43e0-8c5d-114874994f7f tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.182239 Aug 29 21:33:49.165330 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 428/822] 10.222.0.65 () {58 vars in 1134 bytes} [Mon Aug 29 21:33:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:49.188417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8c61f4cc-52cf-44d4-96d1-46d60fac144a tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc8402374c0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:49.345817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8c61f4cc-52cf-44d4-96d1-46d60fac144a tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.161471 Aug 29 21:33:49.347089 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:49.357357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:49.358893 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:49.360453 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-10cf23a6-11e8-4a0e-bc02-a80c9f0e10da tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.387075 Aug 29 21:33:49.361236 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 395/823] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:48 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:49.362257 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 429/824] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Aug 29 21:33:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:49.372328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-01480551-ee7a-4eea-97f2-a16466eced6c tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc8401e14c0>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:49.567062 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-01480551-ee7a-4eea-97f2-a16466eced6c tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.202396 Aug 29 21:33:49.568186 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 396/825] 10.222.0.65 () {58 vars in 1134 bytes} [Mon Aug 29 21:33:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:49.587167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-144760cc-a69a-4f3d-8576-35056f85910f tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc8400d91f0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:49.716618 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-144760cc-a69a-4f3d-8576-35056f85910f tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.134021 Aug 29 21:33:49.717684 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 430/826] 10.222.0.65 () {58 vars in 1167 bytes} [Mon Aug 29 21:33:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:49.743175 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f411b9f1-646b-4849-bc60-c82880f1191d tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc8401d8160>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:49.901506 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f411b9f1-646b-4849-bc60-c82880f1191d tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.165348 Aug 29 21:33:49.916482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 397/827] 10.222.0.65 () {58 vars in 1170 bytes} [Mon Aug 29 21:33:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:49.927702 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-42ee297b-f9f5-4048-a856-74760e369881 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc843af6700>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:50.121946 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-42ee297b-f9f5-4048-a856-74760e369881 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202399 Aug 29 21:33:50.135057 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 431/828] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Aug 29 21:33:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:50.151278 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2d9ca13d-b39f-43ec-b91e-92fb5491e9db tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc8401d8a60>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:50.370561 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2d9ca13d-b39f-43ec-b91e-92fb5491e9db tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.229052 Aug 29 21:33:50.384891 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 398/829] 10.222.0.65 () {58 vars in 1188 bytes} [Mon Aug 29 21:33:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:50.394841 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-562cab1f-0cf9-4b77-ae02-25ec6a7f6959 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] Calling method '.version_select at 0x7fc8401d7700>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:50.405039 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:50.406791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:50.461271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:50.465317 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:50.469888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:50.477687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:50.485247 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:50.486526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:50.626559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-562cab1f-0cf9-4b77-ae02-25ec6a7f6959 tempest-VolumesTestJSON-4545806 tempest-VolumesTestJSON-4545806-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.238201 Aug 29 21:33:50.641050 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 432/830] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Aug 29 21:33:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:50.881676 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:50.894942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:50.898738 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:50.899449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5380651a-fa6f-46e6-aa34-7cd2ce4c7bf8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.501297 Aug 29 21:33:50.900524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 399/831] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:50 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:51.939103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:51.940146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:51.952487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:51.953479 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:51.954253 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:51.955530 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:51.956412 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:51.957187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:52.140964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:52.150065 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:52.152599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:52.154762 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a0ec693d-56e6-4a11-8603-fbe8581159d8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.222606 Aug 29 21:33:52.155861 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 433/832] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:51 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:53.186908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:53.187534 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:53.195090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:53.195575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:53.196046 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:53.196755 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:53.197203 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:53.197624 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:53.338474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:53.349122 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:53.363440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:53.363440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c344a7c2-c484-4388-8d57-4a479b0f08d9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.167665 Aug 29 21:33:53.363440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 400/833] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:53 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:54.055963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:54.060229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:54.063739 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:54.064262 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:54.064701 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:54.065417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:54.065870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:54.066293 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:54.176177 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'services' on Instance uuid 5e3549b2-b215-4a30-b063-31786b24b795 {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:33:54.378787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:54.380069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:54.391985 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:54.392831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:54.393609 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:54.394864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:54.395729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:54.396554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:54.477461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bc60aa88-8ff8-4223-952a-6f777912332a tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments/d975cefa-4a49-4ed1-abf0-b42ad0b75b97" status: 202 len: 0 microversion: 2.1 time: 0.425034 Aug 29 21:33:54.479413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 434/834] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:33:54 2022] DELETE /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments/d975cefa-4a49-4ed1-abf0-b42ad0b75b97 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:33:54.510760 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:54.513270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:54.522783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:54.523574 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:54.524212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:54.526656 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:54.527340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:54.528197 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:54.568284 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-967a6014-792e-41da-9db1-3661c506856e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071130 Aug 29 21:33:54.569282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 435/835] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:33:54 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:54.634197 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:54.649226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:54.652025 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:54.654453 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-bfca085f-7501-4e74-ae69-a3357038bdcd tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.282773 Aug 29 21:33:54.655207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 401/836] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:54 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:55.582800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:55.585147 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:55.593485 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:55.594221 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:55.594652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:55.595401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:55.595875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:55.596366 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:55.638156 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fdc61e73-8560-455b-9cf3-63883ada5337 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059213 Aug 29 21:33:55.639260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 436/837] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:33:55 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:55.678906 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:55.679687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:55.687685 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:55.688271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:55.688791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:55.689654 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:55.690157 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:55.690621 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:55.896156 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:55.913945 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:55.921217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:55.921476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-1c4a2906-8cab-4226-b4db-7ac6e3e85304 req-8a2ce30e-e6a3-47de-8d1b-db933ac7b6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed516ef-b559-450d-b615-b95c82908ee2", "name": "network-vif-plugged", "status": "completed", "tag": "66c8e05e-f016-4ff0-8e7c-2e45a091431f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:55.921683 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f1e888dd-7e64-442e-b2bb-dfae82aeebf0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.244456 Aug 29 21:33:55.921683 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 402/838] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:55 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:55.937011 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1c4a2906-8cab-4226-b4db-7ac6e3e85304 req-8a2ce30e-e6a3-47de-8d1b-db933ac7b6e6 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:55.937892 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1c4a2906-8cab-4226-b4db-7ac6e3e85304 req-8a2ce30e-e6a3-47de-8d1b-db933ac7b6e6 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:55.938756 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1c4a2906-8cab-4226-b4db-7ac6e3e85304 req-8a2ce30e-e6a3-47de-8d1b-db933ac7b6e6 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:55.960252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-1c4a2906-8cab-4226-b4db-7ac6e3e85304 req-8a2ce30e-e6a3-47de-8d1b-db933ac7b6e6 service nova] Creating event network-vif-plugged:66c8e05e-f016-4ff0-8e7c-2e45a091431f for instance 9ed516ef-b559-450d-b615-b95c82908ee2 on hv-cinder-85426 Aug 29 21:33:55.966199 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-1c4a2906-8cab-4226-b4db-7ac6e3e85304 req-8a2ce30e-e6a3-47de-8d1b-db933ac7b6e6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051976 Aug 29 21:33:55.966977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 437/839] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:56.652403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:56.654882 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:56.661251 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.661773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.662191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:56.662913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.663370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.664109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:56.700196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9338b4d2-51ee-4db5-b732-693b293d2647 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052558 Aug 29 21:33:56.706160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 403/840] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Aug 29 21:33:56 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:33:56.778139 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:56.778764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:56.785130 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.785628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.786066 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:56.786777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.787313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.787718 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:56.814589 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:33:56.958031 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:56.958787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:56.966754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.967265 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.967695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:56.968447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.969406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.969853 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:57.279912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c90ffe73-1d33-45b5-a302-bb806fd82026 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 204 len: 0 microversion: 2.1 time: 0.506776 Aug 29 21:33:57.280527 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 438/841] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:33:56 2022] DELETE /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:33:57.289499 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:57.291023 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:57.297437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:57.297913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:57.298539 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:57.299252 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:57.299706 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:57.300395 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:57.446987 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:57.461325 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:57.463694 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:57.464956 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dabaf29c-ff8c-4af7-9b90-89c772c620a9 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.510864 Aug 29 21:33:57.466053 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 404/842] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:56 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:33:57.467745 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:57.484809 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8527f511-350b-4812-8acf-f20b2a468565 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1682 microversion: 2.1 time: 0.199340 Aug 29 21:33:57.485503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 439/843] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:57 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:33:58.488819 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:58.489903 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:58.496509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:58.496995 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:58.497434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:58.498131 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:58.498578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:58.499003 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:58.508258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:58.508258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:58.514767 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:58.515246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:58.515681 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:58.516404 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:58.516906 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:58.517289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:58.522709 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:58.668392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:58.679113 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:58.680638 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:58.681863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5b711c4d-a259-4a25-847a-a4c90980657d tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.197028 Aug 29 21:33:58.683031 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 405/844] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:58 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:58.707763 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:58.720301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-04d74362-4e56-45de-8405-44813de0f642 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1682 microversion: 2.1 time: 0.216589 Aug 29 21:33:58.721170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 440/845] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:58 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:33:59.714048 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:59.714736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:59.721776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:59.722263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:59.722699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:59.723405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:59.723861 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:59.724321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:59.746112 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:59.748100 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:59.760558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:59.761479 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:59.762146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:59.763378 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:59.763850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:59.764482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:59.958613 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:59.967917 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-97c0ed1b-d4d6-4be4-ae65-344ba29c502b tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1682 microversion: 2.1 time: 0.227915 Aug 29 21:33:59.969218 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 441/846] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:59 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:00.042681 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:00.051741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:00.053313 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:00.054611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-711219fa-7885-421c-b726-dc97c0d4a50e tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1729 microversion: 2.20 time: 0.344796 Aug 29 21:34:00.057554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 406/847] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:33:59 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1729 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:00.625369 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-283f3066-c4c2-4a9a-b61d-c8e9c9c8e69e req-eb3c8e05-7c7d-4165-8334-435e9c3915fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e3549b2-b215-4a30-b063-31786b24b795", "name": "network-vif-deleted", "tag": "44144b9e-ff7d-4c65-b8c4-575d2da5e3cc"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:00.640432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-283f3066-c4c2-4a9a-b61d-c8e9c9c8e69e req-eb3c8e05-7c7d-4165-8334-435e9c3915fc service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:00.640432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-283f3066-c4c2-4a9a-b61d-c8e9c9c8e69e req-eb3c8e05-7c7d-4165-8334-435e9c3915fc service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:00.640432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-283f3066-c4c2-4a9a-b61d-c8e9c9c8e69e req-eb3c8e05-7c7d-4165-8334-435e9c3915fc service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:00.655586 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-283f3066-c4c2-4a9a-b61d-c8e9c9c8e69e req-eb3c8e05-7c7d-4165-8334-435e9c3915fc service nova] Creating event network-vif-deleted:44144b9e-ff7d-4c65-b8c4-575d2da5e3cc for instance 5e3549b2-b215-4a30-b063-31786b24b795 on hv-cinder-85426 Aug 29 21:34:00.665514 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-283f3066-c4c2-4a9a-b61d-c8e9c9c8e69e req-eb3c8e05-7c7d-4165-8334-435e9c3915fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047121 Aug 29 21:34:00.667080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 442/848] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:01.004381 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:01.005294 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:01.022652 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:01.023901 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:01.024795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:01.025729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:01.026359 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:01.026981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:01.097510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:01.098369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:01.099030 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:01.099481 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:01.099946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lazy-loading 'fault' on Instance uuid 5e3549b2-b215-4a30-b063-31786b24b795 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:34:01.100909 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:01.124894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:01.127525 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:01.128231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:01.129212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:01.129716 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:01.134243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:01.179876 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c15654f5a14850a1763a020c17c849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8695633e1e2744b6b6554536f1109fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:01.191161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a3ecb54c-d48f-4fea-ab8d-cb59ebf39876 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 200 len: 1332 microversion: 2.1 time: 0.190948 Aug 29 21:34:01.191741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 407/849] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:00 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:01.323155 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:01.332916 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:01.334749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:01.336242 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1b7ef216-5934-4788-98a9-e11dea2ec51c tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1716 microversion: 2.20 time: 0.262954 Aug 29 21:34:01.337844 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 443/850] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:01 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1716 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:34:02.212944 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:02.213703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:02.220500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:02.220971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:02.221400 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:02.222133 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:02.222586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:02.223174 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:02.237242 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 HTTP/1.1 Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:02.238973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:02.240623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '5e3549b2-b215-4a30-b063-31786b24b795'} Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:02.241556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:02.242940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.244846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:02.244846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7f767f9f-b8b7-436d-bcd5-59f7be08def8 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 404 len: 111 microversion: 2.1 time: 0.031740 Aug 29 21:34:02.244846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 408/851] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:02 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:02.250337 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c566ed72-ef03-4ca5-bed4-fcfa6594748e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '.version_select at 0x7fc843b0e430>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:02.257505 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:02.361030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c566ed72-ef03-4ca5-bed4-fcfa6594748e tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554032532" status: 202 len: 0 microversion: 2.1 time: 0.114606 Aug 29 21:34:02.361787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 444/852] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Aug 29 21:34:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554032532 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:34:04.736973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:04.737527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:04.746394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:04.746394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:04.746394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:04.746394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:04.746938 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:04.747461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:04.762673 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 HTTP/1.1 Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:04.764275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.765765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '5e3549b2-b215-4a30-b063-31786b24b795'} Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:04.769831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.771199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.781598 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:04.781598 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-463f2d9d-9e59-4d9f-bf33-426e638809ba tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 404 len: 111 microversion: 2.1 time: 0.032721 Aug 29 21:34:04.781598 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 409/853] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:34:04 2022] DELETE /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:04.781845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:04.781845 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 5e3549b2-b215-4a30-b063-31786b24b795] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:04.942642 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:04.943125 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:04.943555 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:04.944291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:04.944745 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:04.945202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:04.959583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 HTTP/1.1 Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:04.961314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.963564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '5e3549b2-b215-4a30-b063-31786b24b795'} Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:04.965107 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. Aug 29 21:34:04.967301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:04.969732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 5e3549b2-b215-4a30-b063-31786b24b795 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:04.969732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e7fe69ab-b36d-4aa3-b59a-2a40d47cf827 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795" status: 404 len: 111 microversion: 2.1 time: 0.192105 Aug 29 21:34:04.969732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 445/854] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:04 2022] GET /compute/v2.1/servers/5e3549b2-b215-4a30-b063-31786b24b795 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:06.383497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:06.384805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:06.391406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.391935 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.392368 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.393075 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.393533 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.393960 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.410465 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 HTTP/1.1 Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:06.412394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.415946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '8776b21b-316e-4438-a12f-ee8aef1a85e4'} Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:06.418645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.421532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.426128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:06.426128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2bdc6033-6e6e-4cd5-b2fb-6451a74d1445 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 404 len: 111 microversion: 2.1 time: 0.034216 Aug 29 21:34:06.426128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 410/855] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:34:06 2022] DELETE /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:06.427433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:06.427433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 8776b21b-316e-4438-a12f-ee8aef1a85e4] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:06.431111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.432835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.432835 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.437807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.437807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.437807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.449580 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 HTTP/1.1 Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:06.451149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.452948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '8776b21b-316e-4438-a12f-ee8aef1a85e4'} Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:06.453821 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. Aug 29 21:34:06.455131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.456261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 8776b21b-316e-4438-a12f-ee8aef1a85e4 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:06.456261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1d882057-fe72-495d-9bae-10870e711d82 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4" status: 404 len: 111 microversion: 2.1 time: 0.033299 Aug 29 21:34:06.456261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 446/856] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:06 2022] GET /compute/v2.1/servers/8776b21b-316e-4438-a12f-ee8aef1a85e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:06.469147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:06.471639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:06.476194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.476684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.477123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.478443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.478937 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.479391 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.495319 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 HTTP/1.1 Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:06.496957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.499840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': 'c28cecc9-0a87-4560-a3de-51196dcc5ad6'} Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:06.501409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.503856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.506360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:06.506360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c2230b67-2955-44e7-8bee-73f663a63bd4 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 404 len: 111 microversion: 2.1 time: 0.037881 Aug 29 21:34:06.506360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 411/857] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:34:06 2022] DELETE /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:06.509339 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:06.510671 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: c28cecc9-0a87-4560-a3de-51196dcc5ad6] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:06.516393 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.516873 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.517456 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.518111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.518555 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.518984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.533459 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 HTTP/1.1 Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:06.535118 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.536787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'c28cecc9-0a87-4560-a3de-51196dcc5ad6'} Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:06.537636 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. Aug 29 21:34:06.539054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:06.541134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance c28cecc9-0a87-4560-a3de-51196dcc5ad6 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:06.541134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-16de0351-1f60-4fe9-89df-004289b2a5d3 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6" status: 404 len: 111 microversion: 2.1 time: 0.033451 Aug 29 21:34:06.541134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 447/858] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:06 2022] GET /compute/v2.1/servers/c28cecc9-0a87-4560-a3de-51196dcc5ad6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:07.944981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:07.945636 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:07.952374 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:07.952892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:07.953357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:07.954089 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:07.955155 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:07.955979 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:07.973227 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc HTTP/1.1 Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:07.974897 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:07.977272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '979806e6-6c73-40b1-a798-731653815edc'} Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:07.979372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:07.981950 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:07.996150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:07.996150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d2ed9ecc-ac54-47c6-ac7c-1a03f25656e6 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "DELETE /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 404 len: 111 microversion: 2.1 time: 0.035295 Aug 29 21:34:07.996150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 412/859] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:34:07 2022] DELETE /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:07.996537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:07.996537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] [instance: 979806e6-6c73-40b1-a798-731653815edc] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:07.996537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:07.996537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:07.997365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:07.997365 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:07.997614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:07.997971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:08.012778 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] HTTP exception thrown: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Request method failure captured: Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc HTTP/1.1 Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS8VlwhWuGtUcbxPvEwzCEsVE440GcrANaiPMhhjt00eCV0_TWn5OuhEm-X46UlUW_GuKq2USkeNGv3SSaxhi3pt_LbgTpZdl3Ke-MA3uEkXLKkukfpUlHLNs7Nu9KXLjABuJ9FCdQO8MGIeIg4z4LFJfi6U4xJAZqKeEWOlLX58HiQ Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:08.014368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8695633e1e2744b6b6554536f1109fc6", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8695633e1e2744b6b6554536f1109fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 8695633e1e2744b6b6554536f1109fc6 Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92564630 Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 68c15654f5a14850a1763a020c17c849 Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeNegativeTest-92564630-project Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:08.016004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '979806e6-6c73-40b1-a798-731653815edc'} Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:08.016880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. Aug 29 21:34:08.018444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:08.019911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] Returning 404 to user: Instance 979806e6-6c73-40b1-a798-731653815edc could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:08.019911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c917bbc3-59a1-4a0e-8b52-093bdf5e07b9 tempest-AttachVolumeNegativeTest-92564630 tempest-AttachVolumeNegativeTest-92564630-project] 10.222.0.65 "GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc" status: 404 len: 111 microversion: 2.1 time: 0.033593 Aug 29 21:34:08.019911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 448/860] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:07 2022] GET /compute/v2.1/servers/979806e6-6c73-40b1-a798-731653815edc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:34:14.876374 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4db2a0cc-8ca0-45ee-b82c-7a98fe4f438c tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Action: 'create', calling method: .version_select at 0x7fc83bfbdaf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1143695988", "metadata": {"Type": "work"}}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4db2a0cc-8ca0-45ee-b82c-7a98fe4f438c tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Request method failure captured: Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 122 Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTDWuK2KAWQOfdK5qMm3XE6Rh9KM7GfxJOVcqSCJFSleajQ1aeZFGOb-ry9sXlA_TdRUURHmGMtd8ag9LMUyoyXOEKYUz26igo-w6qbOjNlhaKKhPlnXuhp-KUh2ZPFf-jE2wkNUMgJ50I1ZMwMLdJWLW_SzQYsqMVb1tq3pzOSTNms Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:14.884412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd619246aefb4524ac238a8a7afde7cf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 106dfde76b7b4e15918ec31efb416c43 Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1143695988", "metadata": {"Type": "work"}}} Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: Aug 29 21:34:14.886248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1143695988', 'metadata': {'Type': 'work'}}}} Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:14.893258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:34:14.896523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:34:14.899088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:34:14.899088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.899088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4db2a0cc-8ca0-45ee-b82c-7a98fe4f438c tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:14.899088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4db2a0cc-8ca0-45ee-b82c-7a98fe4f438c tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139687 Aug 29 21:34:14.899088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 413/861] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Aug 29 21:34:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 21:34:14.907188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ffa3858f-0fae-473d-8966-c976d817dc4f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Action: 'create', calling method: .version_select at 0x7fc843af6670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-282707630", "metadata": {"Type": "work"}}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ffa3858f-0fae-473d-8966-c976d817dc4f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Request method failure captured: Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 119 Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTDWuK2KAWQOfdK5qMm3XE6Rh9KM7GfxJOVcqSCJFSleajQ1aeZFGOb-ry9sXlA_TdRUURHmGMtd8ag9LMUyoyXOEKYUz26igo-w6qbOjNlhaKKhPlnXuhp-KUh2ZPFf-jE2wkNUMgJ50I1ZMwMLdJWLW_SzQYsqMVb1tq3pzOSTNms Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:14.914840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd619246aefb4524ac238a8a7afde7cf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 106dfde76b7b4e15918ec31efb416c43 Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-282707630", "metadata": {"Type": "work"}}} Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: Aug 29 21:34:14.918037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-282707630', 'metadata': {'Type': 'work'}}}} Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi '0' Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:14.919465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:34:14.922129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:34:14.924694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:34:14.924694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.924694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ffa3858f-0fae-473d-8966-c976d817dc4f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:14.924694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ffa3858f-0fae-473d-8966-c976d817dc4f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024699 Aug 29 21:34:14.924694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 449/862] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Aug 29 21:34:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:34:14.928726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-db185df9-710a-4748-9df1-1ce0cea8036f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Action: 'create', calling method: .version_select at 0x7fc840626b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2070292904", "metadata": {"Type": "work"}}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-db185df9-710a-4748-9df1-1ce0cea8036f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Request method failure captured: Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 119 Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTDWuK2KAWQOfdK5qMm3XE6Rh9KM7GfxJOVcqSCJFSleajQ1aeZFGOb-ry9sXlA_TdRUURHmGMtd8ag9LMUyoyXOEKYUz26igo-w6qbOjNlhaKKhPlnXuhp-KUh2ZPFf-jE2wkNUMgJ50I1ZMwMLdJWLW_SzQYsqMVb1tq3pzOSTNms Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:14.933274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd619246aefb4524ac238a8a7afde7cf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 106dfde76b7b4e15918ec31efb416c43 Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2070292904", "metadata": {"Type": "work"}}} Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: Aug 29 21:34:14.944043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2070292904', 'metadata': {'Type': 'work'}}}} Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi '' Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:14.944963 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:34:14.946633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:34:14.948077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:34:14.948077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:14.948077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-db185df9-710a-4748-9df1-1ce0cea8036f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:14.948077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-db185df9-710a-4748-9df1-1ce0cea8036f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010819 Aug 29 21:34:14.948077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 414/863] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Aug 29 21:34:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:34:14.950267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6b0e7eaf-9994-48e5-9c4c-28bab9c6c952 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Calling method '.version_select at 0x7fc843b0e9d0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:14.994361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-6b0e7eaf-9994-48e5-9c4c-28bab9c6c952 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] HTTP exception thrown: Volume tempest-invalid-165028375 could not be found. Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6b0e7eaf-9994-48e5-9c4c-28bab9c6c952 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Request method failure captured: Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-165028375 HTTP/1.1 Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTDWuK2KAWQOfdK5qMm3XE6Rh9KM7GfxJOVcqSCJFSleajQ1aeZFGOb-ry9sXlA_TdRUURHmGMtd8ag9LMUyoyXOEKYUz26igo-w6qbOjNlhaKKhPlnXuhp-KUh2ZPFf-jE2wkNUMgJ50I1ZMwMLdJWLW_SzQYsqMVb1tq3pzOSTNms Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:14.996770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd619246aefb4524ac238a8a7afde7cf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 106dfde76b7b4e15918ec31efb416c43 Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Volume tempest-invalid-165028375 could not be found. Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'tempest-invalid-165028375'} Aug 29 21:34:14.998881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-165028375 could not be found. (HTTP 404) (Request-ID: req-d242111e-65fc-4c4f-ab0c-6f742db4e4d3) Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.000120 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:15.001630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-165028375 could not be found. Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:15.003206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-165028375 could not be found. Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-165028375 could not be found. Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-6b0e7eaf-9994-48e5-9c4c-28bab9c6c952 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Returning 404 to user: Volume tempest-invalid-165028375 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-6b0e7eaf-9994-48e5-9c4c-28bab9c6c952 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-165028375" status: 404 len: 98 microversion: 2.1 time: 0.053210 Aug 29 21:34:15.004629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 450/864] 10.222.0.65 () {58 vars in 1215 bytes} [Mon Aug 29 21:34:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-165028375 => generated 98 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:34:15.009036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-87eb999d-10a0-46d3-a6f5-3b8a3a5a02f2 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004365 Aug 29 21:34:15.010069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 415/865] 10.222.0.65 () {58 vars in 1140 bytes} [Mon Aug 29 21:34:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 21:34:15.019444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-791e0395-2d5e-483c-841c-14fdfdf8a95b tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003864 Aug 29 21:34:15.020924 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 451/866] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Aug 29 21:34:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 21:34:15.033298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b59f33f6-4402-4046-b6a0-24297371126f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Calling method '.version_select at 0x7fc8401d8820>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:15.076486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-b59f33f6-4402-4046-b6a0-24297371126f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] HTTP exception thrown: Volume e3fa6249-7407-4f83-b4a8-e9a2323b70bd could not be found. Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b59f33f6-4402-4046-b6a0-24297371126f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Request method failure captured: Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/os-volumes/e3fa6249-7407-4f83-b4a8-e9a2323b70bd HTTP/1.1 Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTDWuK2KAWQOfdK5qMm3XE6Rh9KM7GfxJOVcqSCJFSleajQ1aeZFGOb-ry9sXlA_TdRUURHmGMtd8ag9LMUyoyXOEKYUz26igo-w6qbOjNlhaKKhPlnXuhp-KUh2ZPFf-jE2wkNUMgJ50I1ZMwMLdJWLW_SzQYsqMVb1tq3pzOSTNms Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:15.078480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd619246aefb4524ac238a8a7afde7cf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 106dfde76b7b4e15918ec31efb416c43 Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Volume e3fa6249-7407-4f83-b4a8-e9a2323b70bd could not be found. Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': 'e3fa6249-7407-4f83-b4a8-e9a2323b70bd'} Aug 29 21:34:15.080161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3fa6249-7407-4f83-b4a8-e9a2323b70bd could not be found. (HTTP 404) (Request-ID: req-ea64c9eb-4eb7-402d-bcdb-b50bba09a65a) Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.081110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:15.082449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3fa6249-7407-4f83-b4a8-e9a2323b70bd could not be found. Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:34:15.083841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3fa6249-7407-4f83-b4a8-e9a2323b70bd could not be found. Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3fa6249-7407-4f83-b4a8-e9a2323b70bd could not be found. Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b59f33f6-4402-4046-b6a0-24297371126f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Returning 404 to user: Volume e3fa6249-7407-4f83-b4a8-e9a2323b70bd could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b59f33f6-4402-4046-b6a0-24297371126f tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/e3fa6249-7407-4f83-b4a8-e9a2323b70bd" status: 404 len: 109 microversion: 2.1 time: 0.054418 Aug 29 21:34:15.085340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 416/867] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Aug 29 21:34:15 2022] DELETE /compute/v2.1/os-volumes/e3fa6249-7407-4f83-b4a8-e9a2323b70bd => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:15.090482 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e48b1563-b3aa-4be2-8dce-cc03dcdacb89 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Calling method '.version_select at 0x7fc843af6c10>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:15.119030 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-e48b1563-b3aa-4be2-8dce-cc03dcdacb89 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] HTTP exception thrown: Volume f7110513-d30d-425e-a84e-db14bc0de158 could not be found. Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e48b1563-b3aa-4be2-8dce-cc03dcdacb89 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Request method failure captured: Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/os-volumes/f7110513-d30d-425e-a84e-db14bc0de158 HTTP/1.1 Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTDWuK2KAWQOfdK5qMm3XE6Rh9KM7GfxJOVcqSCJFSleajQ1aeZFGOb-ry9sXlA_TdRUURHmGMtd8ag9LMUyoyXOEKYUz26igo-w6qbOjNlhaKKhPlnXuhp-KUh2ZPFf-jE2wkNUMgJ50I1ZMwMLdJWLW_SzQYsqMVb1tq3pzOSTNms Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:15.121024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd619246aefb4524ac238a8a7afde7cf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd619246aefb4524ac238a8a7afde7cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: cd619246aefb4524ac238a8a7afde7cf Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-VolumesNegativeTest-294659024 Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 106dfde76b7b4e15918ec31efb416c43 Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-VolumesNegativeTest-294659024-project Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Volume f7110513-d30d-425e-a84e-db14bc0de158 could not be found. Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'f7110513-d30d-425e-a84e-db14bc0de158'} Aug 29 21:34:15.122628 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7110513-d30d-425e-a84e-db14bc0de158 could not be found. (HTTP 404) (Request-ID: req-ce88ecde-5523-4de5-9d7e-877321a04923) Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.123600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:15.125028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7110513-d30d-425e-a84e-db14bc0de158 could not be found. Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:34:15.126367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7110513-d30d-425e-a84e-db14bc0de158 could not be found. Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7110513-d30d-425e-a84e-db14bc0de158 could not be found. Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e48b1563-b3aa-4be2-8dce-cc03dcdacb89 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] Returning 404 to user: Volume f7110513-d30d-425e-a84e-db14bc0de158 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e48b1563-b3aa-4be2-8dce-cc03dcdacb89 tempest-VolumesNegativeTest-294659024 tempest-VolumesNegativeTest-294659024-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f7110513-d30d-425e-a84e-db14bc0de158" status: 404 len: 109 microversion: 2.1 time: 0.036595 Aug 29 21:34:15.127800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 452/868] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:15 2022] GET /compute/v2.1/os-volumes/f7110513-d30d-425e-a84e-db14bc0de158 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:34:37.788002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=37 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:37.788825 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=72 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:37.793693 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:37.795988 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:37.802628 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.803107 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.804627 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.804627 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.804815 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.805105 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.839108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-820e9a05-6c8e-42b3-95c4-f8ba99eeb263 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051728 Aug 29 21:34:37.839748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 417/869] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Aug 29 21:34:37 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:37.904457 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:37.905233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=27 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:37.909560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:37.913774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:37.917913 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.918385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.918828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.919537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.920078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.920504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.954616 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:34:38.402976 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-78db8dcc-1f14-4fbd-a375-9b94fed992e2 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 204 len: 0 microversion: 2.20 time: 0.500141 Aug 29 21:34:38.403774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 453/870] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Aug 29 21:34:37 2022] DELETE /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:34:38.412609 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:38.413241 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:38.420978 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.421460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.421881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.422569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.423012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.423427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.556498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:38.565600 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:38.567043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:38.568264 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8f35b68f-ed49-4ef6-a7dc-3e71a99e37a1 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.160037 Aug 29 21:34:38.568855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 418/871] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:38 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:34:39.592005 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:39.592721 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:39.599705 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.600213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.600648 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.601335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.601885 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.602305 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.749732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:39.758311 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:39.759751 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:39.760988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-988f6451-44cb-45f0-a728-05d47b14db91 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.173369 Aug 29 21:34:39.761597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 454/872] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:39 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:40.799701 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:40.800371 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:40.806888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.807485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.807942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:40.808631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.809075 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.813909 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:40.945434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:40.956429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:40.957865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:40.959035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-164f380b-371d-4906-9819-da1f1b52a3e8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.163206 Aug 29 21:34:40.959589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 419/873] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:40 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:41.983530 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:41.984230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:41.990600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:41.991080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:41.991546 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:41.992338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:41.992713 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:41.993131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.128985 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:42.138071 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:42.140856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:42.140856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-48f30c21-f68d-4431-a5eb-a5be4b624276 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1722 microversion: 2.20 time: 0.161982 Aug 29 21:34:42.141347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 455/874] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:41 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:34:43.164848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:43.168834 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:43.172692 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:43.173312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:43.173750 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:43.174471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:43.174921 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:43.175346 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:43.295116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:43.308608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-5cd9b611-f847-4335-a1ae-e609b510bb72 req-f6273c92-d75b-4eac-b49e-b9ecf55704f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed516ef-b559-450d-b615-b95c82908ee2", "name": "network-vif-deleted", "tag": "66c8e05e-f016-4ff0-8e7c-2e45a091431f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:43.316549 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:43.318187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:43.319437 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-37001483-a7b1-4c4b-9c5a-8b9b748faca5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1656 microversion: 2.20 time: 0.159278 Aug 29 21:34:43.320379 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 420/875] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:43 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1656 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:34:43.330514 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5cd9b611-f847-4335-a1ae-e609b510bb72 req-f6273c92-d75b-4eac-b49e-b9ecf55704f9 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:43.331043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5cd9b611-f847-4335-a1ae-e609b510bb72 req-f6273c92-d75b-4eac-b49e-b9ecf55704f9 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:43.331475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5cd9b611-f847-4335-a1ae-e609b510bb72 req-f6273c92-d75b-4eac-b49e-b9ecf55704f9 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:43.345194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-5cd9b611-f847-4335-a1ae-e609b510bb72 req-f6273c92-d75b-4eac-b49e-b9ecf55704f9 service nova] Creating event network-vif-deleted:66c8e05e-f016-4ff0-8e7c-2e45a091431f for instance 9ed516ef-b559-450d-b615-b95c82908ee2 on hv-cinder-85426 Aug 29 21:34:43.350573 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-5cd9b611-f847-4335-a1ae-e609b510bb72 req-f6273c92-d75b-4eac-b49e-b9ecf55704f9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045909 Aug 29 21:34:43.351503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 456/876] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:44.345369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:44.345978 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:44.354343 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.354852 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.355299 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.356216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.356680 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.357122 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.399210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.399704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.400198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.401301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lazy-loading 'fault' on Instance uuid 9ed516ef-b559-450d-b615-b95c82908ee2 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:34:44.477389 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:44.487468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:44.489111 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e3f8c861a9c49119fc531e2a159ec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc75af3ba6c442889ce29351414e110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:44.490827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7889a401-2e0d-47d2-9d0e-60447727a1f0 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 200 len: 1371 microversion: 2.20 time: 0.150166 Aug 29 21:34:44.491665 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 421/877] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:44 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:45.523059 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:45.523759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:45.530792 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.531279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.531714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.532452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.532905 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.533332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.553096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] HTTP exception thrown: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Request method failure captured: Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 HTTP/1.1 Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS9uM1iTJJGNIzT5jmR0NgnEbaOkdeIDyvQKoWmZFFcYNPNZu2fzByLWTOo_LltfqoboQnKhjcVRKN95eF3Q2QV6_BAALO0RDrCgzC8Yt3H6CbGLeafC1_ekwb20qDz6qOYJ-JZrDYqqt6m7QTZ40Tl86pMqeEvgFk4FHSN58ZOrp-g Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:45.554787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5bc75af3ba6c442889ce29351414e110", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 0e3f8c861a9c49119fc531e2a159ec9d Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:45.556447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '9ed516ef-b559-450d-b615-b95c82908ee2'} Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:45.557289 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:45.558813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:45.560484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Returning 404 to user: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:45.560484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a3a4f5f8-7b21-405a-ba32-9c94f69874b3 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 404 len: 111 microversion: 2.20 time: 0.038359 Aug 29 21:34:45.560484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 457/878] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:45 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 21:34:45.565393 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f5da7326-f16f-4e1d-99da-c71174aff374 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '.version_select at 0x7fc84034dca0>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:45.685617 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f5da7326-f16f-4e1d-99da-c71174aff374 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538128629" status: 204 len: 0 microversion: 2.20 time: 0.124136 Aug 29 21:34:45.686229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 422/879] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Aug 29 21:34:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538128629 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:34:48.335004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:48.335551 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:48.344325 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.344839 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.345276 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.345988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.346434 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.346859 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.361449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] HTTP exception thrown: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Request method failure captured: Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: DELETE /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 HTTP/1.1 Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS9uM1iTJJGNIzT5jmR0NgnEbaOkdeIDyvQKoWmZFFcYNPNZu2fzByLWTOo_LltfqoboQnKhjcVRKN95eF3Q2QV6_BAALO0RDrCgzC8Yt3H6CbGLeafC1_ekwb20qDz6qOYJ-JZrDYqqt6m7QTZ40Tl86pMqeEvgFk4FHSN58ZOrp-g Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:48.363079 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5bc75af3ba6c442889ce29351414e110", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 0e3f8c861a9c49119fc531e2a159ec9d Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.364850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '9ed516ef-b559-450d-b615-b95c82908ee2'} Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:48.365614 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.366816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.369398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Returning 404 to user: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:48.369398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-df0fab8e-e580-4a1e-82e0-d640606ce7fe tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 404 len: 111 microversion: 2.20 time: 0.033833 Aug 29 21:34:48.369398 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 458/880] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Aug 29 21:34:48 2022] DELETE /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:34:48.374435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:48.375065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 9ed516ef-b559-450d-b615-b95c82908ee2] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:48.381818 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.385417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.385417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.385417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.385417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.386041 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.399053 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] HTTP exception thrown: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Request method failure captured: Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 HTTP/1.1 Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS9uM1iTJJGNIzT5jmR0NgnEbaOkdeIDyvQKoWmZFFcYNPNZu2fzByLWTOo_LltfqoboQnKhjcVRKN95eF3Q2QV6_BAALO0RDrCgzC8Yt3H6CbGLeafC1_ekwb20qDz6qOYJ-JZrDYqqt6m7QTZ40Tl86pMqeEvgFk4FHSN58ZOrp-g Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:48.400826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5bc75af3ba6c442889ce29351414e110", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 0e3f8c861a9c49119fc531e2a159ec9d Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.402622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '9ed516ef-b559-450d-b615-b95c82908ee2'} Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:48.404612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. Aug 29 21:34:48.405955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:48.407256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Returning 404 to user: Instance 9ed516ef-b559-450d-b615-b95c82908ee2 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:48.407256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-81872d32-3ac5-4c3c-ae45-069663e3eac5 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2" status: 404 len: 111 microversion: 2.20 time: 0.033853 Aug 29 21:34:48.407256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 423/881] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:48 2022] GET /compute/v2.1/servers/9ed516ef-b559-450d-b615-b95c82908ee2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:34:49.728609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:49.729144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:49.735953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.736437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.736875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.737577 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.738055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.738481 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.763090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] HTTP exception thrown: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Request method failure captured: Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: DELETE /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a HTTP/1.1 Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDS9uM1iTJJGNIzT5jmR0NgnEbaOkdeIDyvQKoWmZFFcYNPNZu2fzByLWTOo_LltfqoboQnKhjcVRKN95eF3Q2QV6_BAALO0RDrCgzC8Yt3H6CbGLeafC1_ekwb20qDz6qOYJ-JZrDYqqt6m7QTZ40Tl86pMqeEvgFk4FHSN58ZOrp-g Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:34:49.766301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5bc75af3ba6c442889ce29351414e110", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 0e3f8c861a9c49119fc531e2a159ec9d Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.771043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '8ce9c011-918f-4702-83d6-cd5fd83a1a3a'} Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:49.771965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.773380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.775086 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Returning 404 to user: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:49.775086 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9cf7d5df-412f-4f4c-a328-1e2345913eb8 tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 404 len: 111 microversion: 2.20 time: 0.043034 Aug 29 21:34:49.775086 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 459/882] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Aug 29 21:34:49 2022] DELETE /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:34:49.779862 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:49.780500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] [instance: 8ce9c011-918f-4702-83d6-cd5fd83a1a3a] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:49.787294 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.793516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.793516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.793516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.793516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.793948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.804078 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] HTTP exception thrown: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Request method failure captured: Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a HTTP/1.1 Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDS9uM1iTJJGNIzT5jmR0NgnEbaOkdeIDyvQKoWmZFFcYNPNZu2fzByLWTOo_LltfqoboQnKhjcVRKN95eF3Q2QV6_BAALO0RDrCgzC8Yt3H6CbGLeafC1_ekwb20qDz6qOYJ-JZrDYqqt6m7QTZ40Tl86pMqeEvgFk4FHSN58ZOrp-g Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:34:49.805766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5bc75af3ba6c442889ce29351414e110", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5bc75af3ba6c442889ce29351414e110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 5bc75af3ba6c442889ce29351414e110 Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138695255 Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 0e3f8c861a9c49119fc531e2a159ec9d Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138695255-project Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.807631 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '8ce9c011-918f-4702-83d6-cd5fd83a1a3a'} Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:49.808515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. Aug 29 21:34:49.809869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:34:49.811398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] Returning 404 to user: Instance 8ce9c011-918f-4702-83d6-cd5fd83a1a3a could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:49.811398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-11c16440-bc4f-426b-b7b7-981e80bf55ea tempest-AttachVolumeShelveTestJSON-1138695255 tempest-AttachVolumeShelveTestJSON-1138695255-project] 10.222.0.65 "GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a" status: 404 len: 111 microversion: 2.20 time: 0.032928 Aug 29 21:34:49.811398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 424/883] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:49 2022] GET /compute/v2.1/servers/8ce9c011-918f-4702-83d6-cd5fd83a1a3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:35:43.593368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:43.595493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:43.825446 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-3c1cbc3a-efec-4330-9c34-eeb3cf004e76 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Action: 'create', calling method: .version_select at 0x7fc8400d9430>, body: {"keypair": {"name": "tempest-TestShelveInstance-647035061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm/TdFCXxx5C1gYdEV7e2y95qqhCskEQewKvJ9Vk9xRM349pfXKuxG5zpfpBP/FThidpUX8Wg/IabslNttWBpu9Rs8UNihyZA61sDw6Wvwxi219Hu/WGPpNKoR6l9rZTw=="}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:43.843211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-3c1cbc3a-efec-4330-9c34-eeb3cf004e76 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Getting quotas for project ecd13ced46854940b3765ee641390212. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:43.855373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-3c1cbc3a-efec-4330-9c34-eeb3cf004e76 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Getting quotas for user 6576ed5b370049f5bd091512d9803d3c and project ecd13ced46854940b3765ee641390212. Resources: {'key_pairs'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:43.981916 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-3c1cbc3a-efec-4330-9c34-eeb3cf004e76 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.394175 Aug 29 21:35:43.987430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 460/884] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:35:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:49.326814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1075532808", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452"}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:49.334784 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:49.335748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=36 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:49.337129 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 21:35:49.337519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Mon Aug 29 21:35:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Aug 29 21:35:49.341214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 21:35:49.418245 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] validate_networks() for None {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:35:50.052104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:35:50.052762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:35:50.053400 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:35:50.053809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:35:50.054215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:35:50.075235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:50.075828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:50.076309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:50.077076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:50.077663 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:50.077973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:50.111947 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Getting quotas for project 95e230e152ef4693a1e796f87c8e78e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:50.116473 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Getting quotas for user b41fffef80a44eeaabd461ade780058a and project 95e230e152ef4693a1e796f87c8e78e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:50.137662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:35:50.143049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:35:50.265788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-265b018b-733e-497c-b782-d68eec1ccce7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944377 Aug 29 21:35:50.266447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 425/885] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:35:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:35:50.284344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-14a5406b-281e-449d-aaa3-a98d843a80f7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:50.285609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-14a5406b-281e-449d-aaa3-a98d843a80f7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:50.357185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-14a5406b-281e-449d-aaa3-a98d843a80f7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:50.364603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-14a5406b-281e-449d-aaa3-a98d843a80f7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1215 microversion: 2.1 time: 0.090368 Aug 29 21:35:50.376729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 461/886] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:50 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:51.387879 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1c73c0ef-40a9-4ec1-a96e-35b1a6ef830b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:51.388527 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1c73c0ef-40a9-4ec1-a96e-35b1a6ef830b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:51.446210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1c73c0ef-40a9-4ec1-a96e-35b1a6ef830b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:51.453785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1c73c0ef-40a9-4ec1-a96e-35b1a6ef830b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1215 microversion: 2.1 time: 0.070647 Aug 29 21:35:51.454537 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 426/887] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:51 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:52.480776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:52.481334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:52.489352 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.489854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.490295 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.491007 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.491465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.491966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.570121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:52.578592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7b9bff3f-d345-4691-be16-316a10817b81 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1267 microversion: 2.1 time: 0.103819 Aug 29 21:35:52.579171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 462/888] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:52 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:53.602653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:53.603335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:53.610999 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.611815 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.612745 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:53.614067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.614869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.615699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:53.692918 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:53.703005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-87323943-38fd-42ca-ac75-d313624c904b tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1285 microversion: 2.1 time: 0.106169 Aug 29 21:35:53.703602 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 427/889] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:53 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:54.726008 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:54.726858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:54.736039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:54.736776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:54.740627 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:54.742348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:54.743096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:54.743714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:54.981516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:54.998292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fe37e0f7-3198-4c8d-8384-cf9e3b1d1dea tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.276255 Aug 29 21:35:54.998981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 463/890] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:54 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:55.708233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-3b257c62-b2b5-4070-90db-de71626e3f50 req-f320d6fb-d423-42bc-a275-8477e768dcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae282b5-7b4a-4f9a-8baf-27796eab60dd", "tag": "e9a500ab-2c73-4bb3-a1b3-f7a6c16cdb7c"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:55.727526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-3b257c62-b2b5-4070-90db-de71626e3f50 req-f320d6fb-d423-42bc-a275-8477e768dcd8 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:55.728456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-3b257c62-b2b5-4070-90db-de71626e3f50 req-f320d6fb-d423-42bc-a275-8477e768dcd8 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:55.734149 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-3b257c62-b2b5-4070-90db-de71626e3f50 req-f320d6fb-d423-42bc-a275-8477e768dcd8 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:55.753132 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-3b257c62-b2b5-4070-90db-de71626e3f50 req-f320d6fb-d423-42bc-a275-8477e768dcd8 service nova] Creating event network-changed:e9a500ab-2c73-4bb3-a1b3-f7a6c16cdb7c for instance aae282b5-7b4a-4f9a-8baf-27796eab60dd on hv-cinder-85426 Aug 29 21:35:55.768280 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-3b257c62-b2b5-4070-90db-de71626e3f50 req-f320d6fb-d423-42bc-a275-8477e768dcd8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061456 Aug 29 21:35:55.768280 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 428/891] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:56.023115 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:56.024073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:56.031493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:56.032087 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:56.032531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:56.033280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:56.033780 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:56.034279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:56.231454 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:56.242160 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e5ccd53f-710d-4a65-adc7-e8a3deae714e tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.224108 Aug 29 21:35:56.242677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 464/892] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:56 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:57.274320 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:57.280575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.284500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.285160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.285690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.286710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.287295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.288016 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.468600 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:57.477252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-cfc20e71-49da-486f-aa23-75b4862737a1 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.213068 Aug 29 21:35:57.477873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 429/893] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:57 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:58.499708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:58.501192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:58.510050 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:58.511314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:58.512090 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:58.513232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:58.513966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:58.514658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:58.694019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:58.705885 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a47791c9-e38c-486d-9082-1b8bd0ac7a33 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.210748 Aug 29 21:35:58.706654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 465/894] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:58 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:59.736678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:59.737525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:59.744867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.745932 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.746384 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.747137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.747599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.748062 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.944150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:59.958671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-90650e82-2b40-49ed-be13-a172a48596bf tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.225891 Aug 29 21:35:59.959763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 430/895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:59 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:00.995284 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:00.996142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:00.999172 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=6 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:01.005534 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.006035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.006475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:01.007208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.007663 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.008161 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:01.257210 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:01.269626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2df725c8-0845-4117-9fc1-21cd04a4ff20 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.279031 Aug 29 21:36:01.271167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 466/896] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:00 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:02.303682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:02.304448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:02.306356 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:02.307583 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=8 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:02.313310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:02.313773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:02.314257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:02.314968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:02.315416 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:02.315833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:02.514398 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:02.527169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-74fdd25b-6307-4d12-8600-5c23eddac565 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.226961 Aug 29 21:36:02.527992 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 431/897] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:02 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:03.027637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-5990c7b1-5e20-406f-8906-f71c20be8f9b req-932efcfb-ddd4-44da-8a3e-c242c3e50ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae282b5-7b4a-4f9a-8baf-27796eab60dd", "name": "network-vif-plugged", "status": "completed", "tag": "e9a500ab-2c73-4bb3-a1b3-f7a6c16cdb7c"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:03.038876 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5990c7b1-5e20-406f-8906-f71c20be8f9b req-932efcfb-ddd4-44da-8a3e-c242c3e50ac1 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.039428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5990c7b1-5e20-406f-8906-f71c20be8f9b req-932efcfb-ddd4-44da-8a3e-c242c3e50ac1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.039993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5990c7b1-5e20-406f-8906-f71c20be8f9b req-932efcfb-ddd4-44da-8a3e-c242c3e50ac1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.052816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-5990c7b1-5e20-406f-8906-f71c20be8f9b req-932efcfb-ddd4-44da-8a3e-c242c3e50ac1 service nova] Creating event network-vif-plugged:e9a500ab-2c73-4bb3-a1b3-f7a6c16cdb7c for instance aae282b5-7b4a-4f9a-8baf-27796eab60dd on hv-cinder-85426 Aug 29 21:36:03.059193 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-5990c7b1-5e20-406f-8906-f71c20be8f9b req-932efcfb-ddd4-44da-8a3e-c242c3e50ac1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036348 Aug 29 21:36:03.059803 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 467/898] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:03.565986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:03.567163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:03.579222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.580310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.581101 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.582517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.585002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.585002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.773448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:03.780277 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5ae2522c-f176-4448-b50f-3c27f23d550f tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.221287 Aug 29 21:36:03.781005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 432/899] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:03 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:04.803331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:04.804263 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:04.811019 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:04.811503 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:04.811963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:04.812820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:04.813275 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:04.813693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:04.957194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:04.965770 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f70817b8-a14f-488e-b2f8-b6ba9b5638a9 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1315 microversion: 2.1 time: 0.167417 Aug 29 21:36:04.966413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 468/900] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:04 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:05.130808 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-106673006", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-647035061", "security_groups": [{"name": "tempest-secgroup-smoke-682714262"}], "networks": [{"uuid": "c751c7e2-184d-4f27-8a13-c3f74b9178e0"}], "block_device_mapping_v2": [{"uuid": "941f7ff5-cc4c-4dce-aa1a-6bbdf22b2e3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:05.265405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] validate_networks() for [('c751c7e2-184d-4f27-8a13-c3f74b9178e0', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:05.697162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:05.697590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:05.698866 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:05.699530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:05.699993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:05.713159 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.713943 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.714673 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.715417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.716080 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.716768 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.739866 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Getting quotas for project ecd13ced46854940b3765ee641390212. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:05.747345 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Getting quotas for user 6576ed5b370049f5bd091512d9803d3c and project ecd13ced46854940b3765ee641390212. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:05.813899 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:05.816132 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='941f7ff5-cc4c-4dce-aa1a-6bbdf22b2e3c',volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:05.987006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:05.987638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:05.994207 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.006732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.006732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.006732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.006732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.007181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.156142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:06.164643 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-88b2dc4b-b18c-49ec-be2d-adae53ad914c tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1465 microversion: 2.1 time: 0.181718 Aug 29 21:36:06.165251 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 469/901] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:05 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:06.238943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:06.239787 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:06.247476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.253402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.253402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.253402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.253402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.253951 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.278904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:36:06.382223 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ef5b7a99-d4bc-46a6-a9be-36ae68c72d49 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.269125 Aug 29 21:36:06.383122 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 433/902] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:06.394247 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ab2edabb-69f3-4e2d-91f9-86769660039d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:06.394858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ab2edabb-69f3-4e2d-91f9-86769660039d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:06.461681 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ab2edabb-69f3-4e2d-91f9-86769660039d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:06.470321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ab2edabb-69f3-4e2d-91f9-86769660039d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1087 microversion: 2.1 time: 0.079746 Aug 29 21:36:06.470917 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 434/903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:06 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:06.597116 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b30a56eb-d9fa-450a-b1c9-df52562470e6 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "DELETE /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 204 len: 0 microversion: 2.1 time: 0.369003 Aug 29 21:36:06.597711 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 470/904] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:36:06 2022] DELETE /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:36:06.606733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:06.607345 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:06.614024 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.614521 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.614953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.615669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.616421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.616585 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.769507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:06.777952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6996e766-bff6-4e53-a285-a17efe4d2f05 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1471 microversion: 2.1 time: 0.175623 Aug 29 21:36:06.778523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 435/905] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:06 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:07.497583 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-34c36d19-e29c-4640-99aa-845e6f9862bd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:07.498290 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-34c36d19-e29c-4640-99aa-845e6f9862bd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:07.575569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-34c36d19-e29c-4640-99aa-845e6f9862bd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:07.584428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-34c36d19-e29c-4640-99aa-845e6f9862bd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1087 microversion: 2.1 time: 0.091934 Aug 29 21:36:07.585225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 471/906] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:07 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1087 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:07.803614 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:07.805060 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:07.820564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.820564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.820836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.821976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.822764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.823519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.107436 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:08.116768 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-86642eac-2157-4abf-940d-51b585dfdbc3 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1471 microversion: 2.1 time: 0.320944 Aug 29 21:36:08.133523 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 436/907] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:07 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:08.607017 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5bd24497-edc4-4f52-85af-63d22fc60fea tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:08.610753 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5bd24497-edc4-4f52-85af-63d22fc60fea tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:08.689148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-82d0b573-f21c-41bc-82dd-3f327c660b6c req-38c2722f-679b-4e6f-9aa5-2eea65fc6381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae282b5-7b4a-4f9a-8baf-27796eab60dd", "name": "network-vif-deleted", "tag": "e9a500ab-2c73-4bb3-a1b3-f7a6c16cdb7c"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:08.703952 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-82d0b573-f21c-41bc-82dd-3f327c660b6c req-38c2722f-679b-4e6f-9aa5-2eea65fc6381 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.704694 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-82d0b573-f21c-41bc-82dd-3f327c660b6c req-38c2722f-679b-4e6f-9aa5-2eea65fc6381 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.705285 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-82d0b573-f21c-41bc-82dd-3f327c660b6c req-38c2722f-679b-4e6f-9aa5-2eea65fc6381 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.720939 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5bd24497-edc4-4f52-85af-63d22fc60fea tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:08.723713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-82d0b573-f21c-41bc-82dd-3f327c660b6c req-38c2722f-679b-4e6f-9aa5-2eea65fc6381 service nova] Creating event network-vif-deleted:e9a500ab-2c73-4bb3-a1b3-f7a6c16cdb7c for instance aae282b5-7b4a-4f9a-8baf-27796eab60dd on hv-cinder-85426 Aug 29 21:36:08.729674 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-82d0b573-f21c-41bc-82dd-3f327c660b6c req-38c2722f-679b-4e6f-9aa5-2eea65fc6381 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045350 Aug 29 21:36:08.730315 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 437/908] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:08.732717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5bd24497-edc4-4f52-85af-63d22fc60fea tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1087 microversion: 2.1 time: 0.128837 Aug 29 21:36:08.733381 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 472/909] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:08 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1087 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:09.144416 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:09.145124 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:09.152586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:09.158069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:09.158069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:09.158069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:09.158069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:09.159108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:09.204864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:09.205354 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:09.206320 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:09.207096 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lazy-loading 'fault' on Instance uuid aae282b5-7b4a-4f9a-8baf-27796eab60dd {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:36:09.256524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41fffef80a44eeaabd461ade780058a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e230e152ef4693a1e796f87c8e78e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:09.264616 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d3238993-7206-466c-81c5-df23dc6fc352 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 200 len: 1305 microversion: 2.1 time: 0.125117 Aug 29 21:36:09.265192 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 438/910] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:09 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:09.755682 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-fafb278c-3ec2-4927-89b5-1aa143bb4629 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:09.756856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-fafb278c-3ec2-4927-89b5-1aa143bb4629 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:09.820524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-fafb278c-3ec2-4927-89b5-1aa143bb4629 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:09.828376 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-fafb278c-3ec2-4927-89b5-1aa143bb4629 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1087 microversion: 2.1 time: 0.077602 Aug 29 21:36:09.828966 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 473/911] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:09 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:10.285858 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:10.286501 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] [instance: aae282b5-7b4a-4f9a-8baf-27796eab60dd] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:10.293459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.294086 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.295090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.296193 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.296955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.297558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.314690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] HTTP exception thrown: Instance aae282b5-7b4a-4f9a-8baf-27796eab60dd could not be found. Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Request method failure captured: Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd HTTP/1.1 Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTEybFN7rffnw996T7m4Q118HP0hxbGLAFsHFFRO8YBJ36euuDAVZjuKPqyMDX_c7LSr0Vsc0KFN2QU7waPc2UFVqg3l0r8ERX8uu0WNGaxvrmujTT8XDLO5F1RxEWn41V8RpermmA_ASpjx41Ksqa26cIuEqNKlPeUkZMlHZT2gkyo Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 95e230e152ef4693a1e796f87c8e78e1 Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesNegativeTest-1591154853 Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:36:10.316459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/95e230e152ef4693a1e796f87c8e78e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_95e230e152ef4693a1e796f87c8e78e1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/95e230e152ef4693a1e796f87c8e78e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/95e230e152ef4693a1e796f87c8e78e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesNegativeTest-1591154853 Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 95e230e152ef4693a1e796f87c8e78e1 Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesNegativeTest-1591154853 Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesNegativeTest-1591154853-project Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: b41fffef80a44eeaabd461ade780058a Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesNegativeTest-1591154853-project Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance aae282b5-7b4a-4f9a-8baf-27796eab60dd could not be found. Aug 29 21:36:10.318057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': 'aae282b5-7b4a-4f9a-8baf-27796eab60dd'} Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae282b5-7b4a-4f9a-8baf-27796eab60dd could not be found. Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:36:10.318996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae282b5-7b4a-4f9a-8baf-27796eab60dd could not be found. Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae282b5-7b4a-4f9a-8baf-27796eab60dd could not be found. Aug 29 21:36:10.320341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:36:10.321483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] Returning 404 to user: Instance aae282b5-7b4a-4f9a-8baf-27796eab60dd could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:36:10.321483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-04ad7312-deb8-4880-bc2f-c30825c14fe7 tempest-VolumesNegativeTest-1591154853 tempest-VolumesNegativeTest-1591154853-project] 10.222.0.65 "GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd" status: 404 len: 111 microversion: 2.1 time: 0.036273 Aug 29 21:36:10.321483 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 439/912] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:10 2022] GET /compute/v2.1/servers/aae282b5-7b4a-4f9a-8baf-27796eab60dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:36:10.851344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:10.852072 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:10.859520 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.860074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.860492 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.861047 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.861531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.861933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.929265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:10.938702 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8022b704-c961-44dd-9f94-f12a89799004 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1137 microversion: 2.1 time: 0.091809 Aug 29 21:36:10.939413 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 474/913] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:10 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1137 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:11.963301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:11.964589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:11.975207 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.976257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.977973 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.978957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.979640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.980328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.059920 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:12.066729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9a58eead-89af-4667-9718-cceea2499ec4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1137 microversion: 2.1 time: 0.108852 Aug 29 21:36:12.067461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 440/914] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:11 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1137 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:13.088952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:13.089573 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:13.096939 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.097414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.097850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.098546 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.098998 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.099425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.188301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:13.196517 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-95248691-dc39-411f-a791-60da2be78c89 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1185 microversion: 2.1 time: 0.111953 Aug 29 21:36:13.197121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 475/915] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:13 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:14.219474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:14.220160 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:14.226722 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.227209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.227639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.228673 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.229683 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.230073 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.339384 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:14.351606 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dead28c2-1e5c-4938-b274-0ba78ce4185c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1203 microversion: 2.1 time: 0.136482 Aug 29 21:36:14.352283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 441/916] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:14 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1203 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:15.377281 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:15.377970 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:15.386128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.386969 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.387423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.392820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.393621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.394346 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.554556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:15.569999 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-605b087f-7d84-4686-a95b-14f5ce8ca2a2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1270 microversion: 2.1 time: 0.197542 Aug 29 21:36:15.571307 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 476/917] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:15 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:15.890695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-b473c621-50ca-444c-a11c-82ab54a86061 req-424e794c-c85a-4748-9823-712ae8837930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be1edde-e1cc-4d22-a11b-a050e511161e", "tag": "a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:15.896648 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:15.904517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b473c621-50ca-444c-a11c-82ab54a86061 req-424e794c-c85a-4748-9823-712ae8837930 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.904982 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b473c621-50ca-444c-a11c-82ab54a86061 req-424e794c-c85a-4748-9823-712ae8837930 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.905407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-b473c621-50ca-444c-a11c-82ab54a86061 req-424e794c-c85a-4748-9823-712ae8837930 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.918888 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-b473c621-50ca-444c-a11c-82ab54a86061 req-424e794c-c85a-4748-9823-712ae8837930 service nova] Creating event network-changed:a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305 for instance 0be1edde-e1cc-4d22-a11b-a050e511161e on hv-cinder-85426 Aug 29 21:36:15.924799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-b473c621-50ca-444c-a11c-82ab54a86061 req-424e794c-c85a-4748-9823-712ae8837930 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039536 Aug 29 21:36:15.926203 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 442/918] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:16.611216 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:16.611762 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:16.624302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:16.625184 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:16.626033 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.627344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:16.628226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:16.628910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.828957 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.842989 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ac5c8aec-1df2-45fd-9a84-09afdfd66f07 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.240744 Aug 29 21:36:16.843978 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 477/919] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:16 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:17.882346 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:17.886704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:17.886704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=8 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:17.893871 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.894368 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.894856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.896121 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.896793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.897499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.133526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.146974 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d16abd3d-22ce-45cf-89d6-063dc62b8c86 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.272362 Aug 29 21:36:18.148496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 443/920] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:17 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:19.182489 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:19.183332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:19.190335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.190990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.191431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.192200 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.192661 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.193092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.388251 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:19.403202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-932ca2df-ce48-4829-a515-5b6470666e5f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.224981 Aug 29 21:36:19.404291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 478/921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:19 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:20.433729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:20.435180 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:20.441851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:20.450104 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.451471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.452408 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.455255 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.456233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.457411 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.467748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=81 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:20.751565 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:20.764100 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b6e46814-f9ee-4225-adb2-92c6041733d3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.337803 Aug 29 21:36:20.766053 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 444/922] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:20 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:21.787736 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:21.788775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:21.790444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=6 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:21.796694 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.797740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.798168 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.799764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.800897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.801353 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.012575 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:22.024839 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-be031ee8-3142-4d97-b6bc-06fa5045956e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.241422 Aug 29 21:36:22.025461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 479/923] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:21 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:23.051728 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:23.054413 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:23.068995 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.070292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.071036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.072394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.073604 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.074689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.397123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.413189 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b2345199-800b-4e63-bc35-a1f48cd05176 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.368831 Aug 29 21:36:23.413795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 445/924] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:23 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:24.439641 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:24.442909 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:24.446844 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1968128139", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "networks": [{"uuid": "9529232b-4c61-4df9-b4c2-2920904b6b0d"}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:24.454057 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:24.458371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.459258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.460102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.461417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.462654 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.463959 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.501642 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:24.555090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] validate_networks() for [('9529232b-4c61-4df9-b4c2-2920904b6b0d', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:24.727919 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:24.765355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-109c0ac6-8bab-42bf-b89e-be1f8ba6c28a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.333650 Aug 29 21:36:24.767868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 480/925] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:24 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:25.142171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:25.142614 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:25.143127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:25.143530 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:25.144005 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:25.153848 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.154323 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.154754 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.155472 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.155942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.156365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.180740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Getting quotas for project 2113bed9d7c04c4691ff173ac0f3d75a. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:25.189195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Getting quotas for user cce4a98431d74dd5a6494214d0d1188e and project 2113bed9d7c04c4691ff173ac0f3d75a. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:25.203594 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:25.206015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:25.397485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4e3fe15e-fb60-4916-9058-985f4ceaa686 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963309 Aug 29 21:36:25.398153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 446/926] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:25.409761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9fcf1b68-d8f3-427a-bbe3-96ae72b87e6e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:25.410786 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9fcf1b68-d8f3-427a-bbe3-96ae72b87e6e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:25.501611 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9fcf1b68-d8f3-427a-bbe3-96ae72b87e6e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:25.513855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9fcf1b68-d8f3-427a-bbe3-96ae72b87e6e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1219 microversion: 2.1 time: 0.108116 Aug 29 21:36:25.520964 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 481/927] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:25 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:25.801333 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:25.802517 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:25.811733 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.812442 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.813000 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.814273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.815163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.815702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.009409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.020144 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-beb1f25a-4131-4bd4-913f-e25e9a666470 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.224441 Aug 29 21:36:26.020948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 447/928] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:25 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:26.540192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-4dd8cc3b-bbe3-4a47-9e2d-d673a5b86a63 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:26.540842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-4dd8cc3b-bbe3-4a47-9e2d-d673a5b86a63 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:26.605425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-4dd8cc3b-bbe3-4a47-9e2d-d673a5b86a63 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.614038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-4dd8cc3b-bbe3-4a47-9e2d-d673a5b86a63 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1219 microversion: 2.1 time: 0.077825 Aug 29 21:36:26.614638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 482/929] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:26 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:27.042335 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:27.043194 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:27.061211 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.061715 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.062155 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.062881 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.063329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.064139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.116136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-c8398c05-abe6-4c8c-8e8d-333f0503486e req-4590603c-294b-4a92-b5e7-82020d0282f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be1edde-e1cc-4d22-a11b-a050e511161e", "name": "network-vif-plugged", "status": "completed", "tag": "a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:27.135777 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c8398c05-abe6-4c8c-8e8d-333f0503486e req-4590603c-294b-4a92-b5e7-82020d0282f1 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.138496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c8398c05-abe6-4c8c-8e8d-333f0503486e req-4590603c-294b-4a92-b5e7-82020d0282f1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.139081 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c8398c05-abe6-4c8c-8e8d-333f0503486e req-4590603c-294b-4a92-b5e7-82020d0282f1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.171526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-c8398c05-abe6-4c8c-8e8d-333f0503486e req-4590603c-294b-4a92-b5e7-82020d0282f1 service nova] Creating event network-vif-plugged:a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305 for instance 0be1edde-e1cc-4d22-a11b-a050e511161e on hv-cinder-85426 Aug 29 21:36:27.171526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-c8398c05-abe6-4c8c-8e8d-333f0503486e req-4590603c-294b-4a92-b5e7-82020d0282f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047860 Aug 29 21:36:27.171526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 483/930] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:27.286571 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:27.295682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-33c387a8-42ad-472f-97a9-fecbcab7909b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.257941 Aug 29 21:36:27.296482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 448/931] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:27 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:27.641237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:27.642452 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:27.650371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.650854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.651292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.652032 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.652487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.652908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.733287 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:27.746499 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0e3a0bfc-5daa-40be-bb74-14ee5f764d46 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1271 microversion: 2.1 time: 0.115330 Aug 29 21:36:27.751360 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 484/932] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:27 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:28.311701 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-930635439", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "networks": [{"uuid": "0508be15-3a86-487c-adf7-1d58f6ff1acd"}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:28.322377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:28.323679 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:28.334305 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.335179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.336109 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.337003 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.338176 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.338869 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.376109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] validate_networks() for [('0508be15-3a86-487c-adf7-1d58f6ff1acd', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:28.523768 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.530193 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-073426c0-47f4-4704-9422-48eb967653ef tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1258 microversion: 2.1 time: 0.214494 Aug 29 21:36:28.531025 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 485/933] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:28 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:28.770712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:28.772461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:28.785801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.787099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.788161 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.790167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.791576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.792437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.843094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:28.843094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:28.843094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:28.843094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:28.843094 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:28.843863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.844591 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.845235 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.845971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.846420 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.846842 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.866914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Getting quotas for project b233fa99a6f44783bdd72e14b28bf441. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:28.871861 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Getting quotas for user ee513b3ba1d545a696c08448370680e5 and project b233fa99a6f44783bdd72e14b28bf441. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:28.886741 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:28.889607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:28.892256 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.907301 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7401f1a4-3362-4949-8740-831036588530 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1279 microversion: 2.1 time: 0.142377 Aug 29 21:36:28.912064 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 486/934] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:28 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:29.063623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-712af029-ea85-4a8d-949b-dcf89f558b64 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756653 Aug 29 21:36:29.064617 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 449/935] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:29.076681 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b9dccc60-897f-4413-8aab-41c6cc9381fb tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.077625 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b9dccc60-897f-4413-8aab-41c6cc9381fb tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.159283 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b9dccc60-897f-4413-8aab-41c6cc9381fb tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.171428 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b9dccc60-897f-4413-8aab-41c6cc9381fb tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1213 microversion: 2.1 time: 0.098680 Aug 29 21:36:29.183218 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 487/936] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:29.556524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.557254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.565188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.565806 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.566319 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.567127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.567667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.568234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.808406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.817761 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-be793e8f-5c9c-485a-95fe-8e338d534147 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1441 microversion: 2.1 time: 0.265581 Aug 29 21:36:29.818457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 450/937] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1441 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:29.840444 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.841638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.848652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.851725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.851725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.851725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.851725 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.852363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.936700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.937867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.944191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.944930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.945558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.946439 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.948611 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.949248 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:30.020901 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:30.032389 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bee72d15-14c4-470d-977e-cee404d3aad0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1441 microversion: 2.1 time: 0.197357 Aug 29 21:36:30.033887 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 488/938] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1441 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:30.035786 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:30.044084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d90cceb2-622b-40c7-afaa-316a000e534c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1277 microversion: 2.1 time: 0.111293 Aug 29 21:36:30.044860 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 451/939] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:30.216893 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f5700acb-14e0-41ee-a343-cfec55f5a7d4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:30.218069 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f5700acb-14e0-41ee-a343-cfec55f5a7d4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:30.580449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f5700acb-14e0-41ee-a343-cfec55f5a7d4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:30.591161 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f5700acb-14e0-41ee-a343-cfec55f5a7d4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1213 microversion: 2.1 time: 0.389863 Aug 29 21:36:30.599340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 489/940] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:30 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1213 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:31.071965 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:31.074662 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:31.086804 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.087663 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.088312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.089558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.090383 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.091037 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.334827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.350266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8e929ecc-e178-4e6c-ad96-7f72e9562eac tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.286401 Aug 29 21:36:31.351356 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 452/941] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:31 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:31.471345 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-458b1875-5ee2-499e-8eca-4418d8cfa0f4 req-d65738c2-d6ca-427f-8780-48f6af8a18c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47577035-d2fd-4b3b-859f-a21376bdc501", "tag": "028b4efd-3a98-4e9f-b5ce-441d012207a9"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:31.488693 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-458b1875-5ee2-499e-8eca-4418d8cfa0f4 req-d65738c2-d6ca-427f-8780-48f6af8a18c1 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.489533 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-458b1875-5ee2-499e-8eca-4418d8cfa0f4 req-d65738c2-d6ca-427f-8780-48f6af8a18c1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.490040 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-458b1875-5ee2-499e-8eca-4418d8cfa0f4 req-d65738c2-d6ca-427f-8780-48f6af8a18c1 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.510483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-458b1875-5ee2-499e-8eca-4418d8cfa0f4 req-d65738c2-d6ca-427f-8780-48f6af8a18c1 service nova] Creating event network-changed:028b4efd-3a98-4e9f-b5ce-441d012207a9 for instance 47577035-d2fd-4b3b-859f-a21376bdc501 on hv-cinder-85426 Aug 29 21:36:31.519186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-458b1875-5ee2-499e-8eca-4418d8cfa0f4 req-d65738c2-d6ca-427f-8780-48f6af8a18c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052712 Aug 29 21:36:31.520633 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 490/942] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:31.617312 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:31.618573 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:31.631275 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.635040 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.635040 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.636234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.637151 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.638062 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.769583 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.787640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-bbc64424-1043-4b42-a1f9-350f9cf86317 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1265 microversion: 2.1 time: 0.177226 Aug 29 21:36:31.788873 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 453/943] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:31 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:32.379277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:32.380419 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:32.389811 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.390649 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.391286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.392326 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.393275 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.393952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.598311 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:32.618026 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bba428c9-fdfa-44c6-95e3-b65c81f5132d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.244660 Aug 29 21:36:32.619714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 491/944] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:32 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:32.812817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:32.813536 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:32.823051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.827928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.827928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.827928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.827928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.828370 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.911057 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:32.923080 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b41460cb-641f-4e25-8c44-c68b019c7f06 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1273 microversion: 2.1 time: 0.115323 Aug 29 21:36:32.923601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 454/945] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:32 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:33.340422 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-1740b4a9-b2ac-4183-9ff6-803765ef20e3 req-33fa98ac-9cee-42a0-a8b3-a72a8c16aa30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be1edde-e1cc-4d22-a11b-a050e511161e", "tag": "a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:33.366025 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1740b4a9-b2ac-4183-9ff6-803765ef20e3 req-33fa98ac-9cee-42a0-a8b3-a72a8c16aa30 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.366903 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1740b4a9-b2ac-4183-9ff6-803765ef20e3 req-33fa98ac-9cee-42a0-a8b3-a72a8c16aa30 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.367359 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-1740b4a9-b2ac-4183-9ff6-803765ef20e3 req-33fa98ac-9cee-42a0-a8b3-a72a8c16aa30 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.385988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-1740b4a9-b2ac-4183-9ff6-803765ef20e3 req-33fa98ac-9cee-42a0-a8b3-a72a8c16aa30 service nova] Creating event network-changed:a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305 for instance 0be1edde-e1cc-4d22-a11b-a050e511161e on hv-cinder-85426 Aug 29 21:36:33.394794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-1740b4a9-b2ac-4183-9ff6-803765ef20e3 req-33fa98ac-9cee-42a0-a8b3-a72a8c16aa30 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058907 Aug 29 21:36:33.396606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 492/946] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:33.648552 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:33.649895 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:33.660915 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.661822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.662929 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.664547 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.666012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.666791 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.947863 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:33.949220 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:33.957396 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.958156 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.958598 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.959317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.959768 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.960223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.300009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:34.313843 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-51f5fba2-2b6a-4ead-afa6-5ceee1d025e7 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.370577 Aug 29 21:36:34.318232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 493/947] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:33 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:34.342775 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:34.355734 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4bc76539-e8c8-4c82-b376-5b75d075677b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.715713 Aug 29 21:36:34.357079 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 455/948] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:33 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:35.283785 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-3659e4b9-cd37-407f-b90c-42c4bf4dff4b req-8d748737-fe37-4cba-bc64-21a6e05ac40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b734865b-326e-4d7b-8d4c-9e2d2002f260", "tag": "07736f54-608f-4ccb-b7a3-2d18ac6c9fe8"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:35.296927 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-3659e4b9-cd37-407f-b90c-42c4bf4dff4b req-8d748737-fe37-4cba-bc64-21a6e05ac40a service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.297508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-3659e4b9-cd37-407f-b90c-42c4bf4dff4b req-8d748737-fe37-4cba-bc64-21a6e05ac40a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.297950 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-3659e4b9-cd37-407f-b90c-42c4bf4dff4b req-8d748737-fe37-4cba-bc64-21a6e05ac40a service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.311578 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-3659e4b9-cd37-407f-b90c-42c4bf4dff4b req-8d748737-fe37-4cba-bc64-21a6e05ac40a service nova] Creating event network-changed:07736f54-608f-4ccb-b7a3-2d18ac6c9fe8 for instance b734865b-326e-4d7b-8d4c-9e2d2002f260 on hv-cinder-85426 Aug 29 21:36:35.317713 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-3659e4b9-cd37-407f-b90c-42c4bf4dff4b req-8d748737-fe37-4cba-bc64-21a6e05ac40a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039302 Aug 29 21:36:35.318499 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 494/949] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:35.340627 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:35.341246 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:35.349842 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.350485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.350608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.351292 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.351752 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.352210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.379435 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:35.380461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:35.388304 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.388961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.389235 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.390152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.390889 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.391483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.540593 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:35.549788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c8e91e7e-bde6-4cf6-a998-851e7f4482eb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.174515 Aug 29 21:36:35.550209 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 495/950] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:35 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:35.600759 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:35.609415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e68396ca-baab-444b-82b3-35e84bdd3598 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.273212 Aug 29 21:36:35.610091 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 456/951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:35 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:36.570880 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:36.571484 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:36.578661 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.579144 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.579584 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.580316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.580765 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.581218 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.633178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:36.633930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:36.641683 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.642171 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.642610 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.643321 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.643772 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.644234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.737943 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.749771 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5be897c5-52bd-488f-bc94-3c336192e681 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.182667 Aug 29 21:36:36.757085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 496/952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:36 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:36.874181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.882727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0715e776-6674-4888-ba77-59fa3db6621f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.254435 Aug 29 21:36:36.883298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 457/953] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:36 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:37.772197 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:37.772745 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:37.779564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.780193 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.781146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.781898 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.782552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.782836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.904615 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:37.905254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:37.912301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.912795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.913236 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.913949 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.914407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.914833 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.925054 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:37.933129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-700b6312-a4a3-407f-ab11-6a99559a27a6 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.164943 Aug 29 21:36:37.933805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 497/954] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:37 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:38.049127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:38.058116 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7a4aba89-61f5-460a-a58e-b82c69ac978a tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.158244 Aug 29 21:36:38.058707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 458/955] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:37 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:38.954414 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:38.955141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:38.962141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:38.962538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:38.963016 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:38.963707 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:38.964357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:38.964875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.080123 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:39.081250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:39.083456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=4 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:39.084892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=12 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:39.090797 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.091443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.092289 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.092943 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.093642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.094437 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.115554 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:39.119648 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b34b812a-7e87-48bf-a40a-3ce14474fe0e tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.169716 Aug 29 21:36:39.120298 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 498/956] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:38 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:39.166043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-8a443d57-dc66-4451-a4a8-5777fc5d8a40 req-a0155ce0-6a6c-42e0-84b5-88f6e773e305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47577035-d2fd-4b3b-859f-a21376bdc501", "name": "network-vif-plugged", "status": "completed", "tag": "028b4efd-3a98-4e9f-b5ce-441d012207a9"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:39.178918 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-8a443d57-dc66-4451-a4a8-5777fc5d8a40 req-a0155ce0-6a6c-42e0-84b5-88f6e773e305 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.179623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-8a443d57-dc66-4451-a4a8-5777fc5d8a40 req-a0155ce0-6a6c-42e0-84b5-88f6e773e305 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.180148 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-8a443d57-dc66-4451-a4a8-5777fc5d8a40 req-a0155ce0-6a6c-42e0-84b5-88f6e773e305 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.194575 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-8a443d57-dc66-4451-a4a8-5777fc5d8a40 req-a0155ce0-6a6c-42e0-84b5-88f6e773e305 service nova] Creating event network-vif-plugged:028b4efd-3a98-4e9f-b5ce-441d012207a9 for instance 47577035-d2fd-4b3b-859f-a21376bdc501 on hv-cinder-85426 Aug 29 21:36:39.200334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-8a443d57-dc66-4451-a4a8-5777fc5d8a40 req-a0155ce0-6a6c-42e0-84b5-88f6e773e305 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039558 Aug 29 21:36:39.201668 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 499/957] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:39.268803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:39.278868 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c9e48654-bf1f-45bd-af55-67fd40323e2f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.203954 Aug 29 21:36:39.280295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 459/958] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:39 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:40.140860 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:40.141602 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:40.148352 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.148829 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.149265 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.150250 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.150963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.151597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.292731 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:40.301223 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-8f2bfaff-6c75-4e97-ab6c-4ca9884a8685 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.164582 Aug 29 21:36:40.301816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 500/959] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:40 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:40.303098 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:40.303747 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:40.311476 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.312191 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.312346 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.313228 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.313608 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.313932 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.456846 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:40.464951 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a45b7d06-4765-4fe1-b42b-1173d02abced tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.166095 Aug 29 21:36:40.465534 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 460/960] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:40 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:41.215131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-4e7283ae-d510-4615-9edb-e30cd853e330 req-5b43ba62-ffcc-4dd1-95c4-9df59828cf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b734865b-326e-4d7b-8d4c-9e2d2002f260", "name": "network-vif-plugged", "status": "completed", "tag": "07736f54-608f-4ccb-b7a3-2d18ac6c9fe8"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:41.220270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=8 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:41.225797 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-4e7283ae-d510-4615-9edb-e30cd853e330 req-5b43ba62-ffcc-4dd1-95c4-9df59828cf56 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.226271 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-4e7283ae-d510-4615-9edb-e30cd853e330 req-5b43ba62-ffcc-4dd1-95c4-9df59828cf56 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.226697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-4e7283ae-d510-4615-9edb-e30cd853e330 req-5b43ba62-ffcc-4dd1-95c4-9df59828cf56 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.238002 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-4e7283ae-d510-4615-9edb-e30cd853e330 req-5b43ba62-ffcc-4dd1-95c4-9df59828cf56 service nova] Creating event network-vif-plugged:07736f54-608f-4ccb-b7a3-2d18ac6c9fe8 for instance b734865b-326e-4d7b-8d4c-9e2d2002f260 on hv-cinder-85426 Aug 29 21:36:41.245804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-4e7283ae-d510-4615-9edb-e30cd853e330 req-5b43ba62-ffcc-4dd1-95c4-9df59828cf56 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031948 Aug 29 21:36:41.245804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 501/961] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:41.325326 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:41.325965 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:41.332702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.333185 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.333681 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.334377 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.334946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.335257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.494311 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:41.495376 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:41.501984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:41.504214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.504589 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.505232 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.505967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.506596 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.507239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.513870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1c23c8bc-74b6-4d30-a820-d840e54992bb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1319 microversion: 2.1 time: 0.192593 Aug 29 21:36:41.520619 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 461/962] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:41 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:41.646206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:41.654629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ac2fba47-11b6-46ad-b822-929a33e9a7ac tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.169897 Aug 29 21:36:41.655254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 502/963] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:41 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:42.537209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:42.537749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:42.544349 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.544829 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.545258 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.545958 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.546409 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.546867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.549674 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=100 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:42.674639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:42.675253 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:42.682479 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.682971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.683401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.684173 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.684801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.685237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.689139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:42.698639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c003e3e6-65d9-4e9d-89e4-be3a258f1d7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1507 microversion: 2.1 time: 0.165648 Aug 29 21:36:42.699231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 462/964] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:42 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:42.840857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:42.850078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c2d1c117-f340-4c47-815d-cac3cd9736c4 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1313 microversion: 2.1 time: 0.179255 Aug 29 21:36:42.850661 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 503/965] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:42 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:43.872678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:43.873288 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:43.879761 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.880234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.880663 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.881364 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.881800 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.882217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:44.023118 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:44.032497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8973c4ee-dcf9-41c8-a46d-2a2a6219c677 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1497 microversion: 2.1 time: 0.164186 Aug 29 21:36:44.033229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 463/966] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:43 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:45.154915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:45.154915 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:45.161802 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.162294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.162733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.163445 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.163961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.178177 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.203707 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:36:45.221077 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=100 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:45.550674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d4d21f72-80a0-4f48-b1a5-030590287072 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 204 len: 0 microversion: 2.1 time: 0.400073 Aug 29 21:36:45.552074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 504/967] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:36:45 2022] DELETE /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:36:45.572865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:45.574820 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:45.592762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.592762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.592762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.592762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.593159 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.594087 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.777306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:45.786725 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1fa8525e-89bb-4242-aadb-40dc097843fd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1503 microversion: 2.1 time: 0.223112 Aug 29 21:36:45.787433 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 464/968] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:45 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:46.810221 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:46.810910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:46.817666 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.822027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.822027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.822027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.822027 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.823124 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.960288 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:46.968158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0356486d-3813-4dfa-b725-221e159cdad1 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1503 microversion: 2.1 time: 0.163136 Aug 29 21:36:46.968752 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 505/969] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:46 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:47.990128 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:47.990699 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:47.997928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:47.998726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:47.998847 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:47.999916 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:48.000038 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:48.000410 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:48.194204 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-35bdf084-0679-4e10-8d37-41a8d56e4d5b req-98dc4c7d-1d53-4f01-a240-4f340ff7353f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b734865b-326e-4d7b-8d4c-9e2d2002f260", "name": "network-vif-deleted", "tag": "07736f54-608f-4ccb-b7a3-2d18ac6c9fe8"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:48.208341 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-35bdf084-0679-4e10-8d37-41a8d56e4d5b req-98dc4c7d-1d53-4f01-a240-4f340ff7353f service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:48.208877 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-35bdf084-0679-4e10-8d37-41a8d56e4d5b req-98dc4c7d-1d53-4f01-a240-4f340ff7353f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:48.209294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-35bdf084-0679-4e10-8d37-41a8d56e4d5b req-98dc4c7d-1d53-4f01-a240-4f340ff7353f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:48.219842 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:48.229009 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-60026fa7-48e4-4f1e-a025-5a512688bf46 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1503 microversion: 2.1 time: 0.242736 Aug 29 21:36:48.232646 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 465/970] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:47 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:48.232794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-35bdf084-0679-4e10-8d37-41a8d56e4d5b req-98dc4c7d-1d53-4f01-a240-4f340ff7353f service nova] Creating event network-vif-deleted:07736f54-608f-4ccb-b7a3-2d18ac6c9fe8 for instance b734865b-326e-4d7b-8d4c-9e2d2002f260 on hv-cinder-85426 Aug 29 21:36:48.238313 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-35bdf084-0679-4e10-8d37-41a8d56e4d5b req-98dc4c7d-1d53-4f01-a240-4f340ff7353f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051876 Aug 29 21:36:48.239231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 506/971] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:49.251238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:49.251841 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:49.260098 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:49.260630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:49.261068 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:49.261762 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:49.262244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:49.262630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:49.297002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:49.297481 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:49.297913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:49.298358 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lazy-loading 'fault' on Instance uuid b734865b-326e-4d7b-8d4c-9e2d2002f260 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:36:49.341155 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:49.349228 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c2a12117-367e-400d-87e4-63f752167027 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 200 len: 1303 microversion: 2.1 time: 0.102722 Aug 29 21:36:49.349793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 466/972] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:49 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:50.371690 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:50.372870 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: b734865b-326e-4d7b-8d4c-9e2d2002f260] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:50.378619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.379097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.379531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.380255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.380710 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.381135 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.395111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] HTTP exception thrown: Instance b734865b-326e-4d7b-8d4c-9e2d2002f260 could not be found. Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Request method failure captured: Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 HTTP/1.1 Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTFZIqykfTKuaVtVCc-_V19ccg02xzkWLqbvd-0HVSPOIhTC-nXUCCQ-CPw16xAZRuGckqsDBNS0oXeZCC-6oLtlX51A5NUO4kxwDrIs6zo1ejjRndVJwESXEIfhfspk8hE7AFwER5bW_4tLgEZFfLMwLm_2iycyqKR2RpipAJMY_rM Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: b233fa99a6f44783bdd72e14b28bf441 Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-VolumesActionsTest-142771176 Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:36:50.396738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b233fa99a6f44783bdd72e14b28bf441"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b233fa99a6f44783bdd72e14b28bf441", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b233fa99a6f44783bdd72e14b28bf441"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b233fa99a6f44783bdd72e14b28bf441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-VolumesActionsTest-142771176 Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: b233fa99a6f44783bdd72e14b28bf441 Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-VolumesActionsTest-142771176 Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-VolumesActionsTest-142771176-project Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: ee513b3ba1d545a696c08448370680e5 Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-VolumesActionsTest-142771176-project Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance b734865b-326e-4d7b-8d4c-9e2d2002f260 could not be found. Aug 29 21:36:50.398443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'b734865b-326e-4d7b-8d4c-9e2d2002f260'} Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b734865b-326e-4d7b-8d4c-9e2d2002f260 could not be found. Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:36:50.400149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b734865b-326e-4d7b-8d4c-9e2d2002f260 could not be found. Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b734865b-326e-4d7b-8d4c-9e2d2002f260 could not be found. Aug 29 21:36:50.401897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:36:50.403430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Returning 404 to user: Instance b734865b-326e-4d7b-8d4c-9e2d2002f260 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:36:50.403430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d8cced48-f871-46e0-ad4d-5867a5608519 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260" status: 404 len: 111 microversion: 2.1 time: 0.031207 Aug 29 21:36:50.403430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 507/973] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:50 2022] GET /compute/v2.1/servers/b734865b-326e-4d7b-8d4c-9e2d2002f260 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:36:50.451199 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1751677977", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "networks": [{"uuid": "0508be15-3a86-487c-adf7-1d58f6ff1acd"}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:50.505813 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] validate_networks() for [('0508be15-3a86-487c-adf7-1d58f6ff1acd', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:50.902492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:50.902492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:50.902492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:50.902492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:50.902492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:50.907357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.908205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.908348 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.908951 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.909403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.909847 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.927054 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Getting quotas for project b233fa99a6f44783bdd72e14b28bf441. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:50.931460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Getting quotas for user ee513b3ba1d545a696c08448370680e5 and project b233fa99a6f44783bdd72e14b28bf441. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:50.942492 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:50.944714 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:51.212682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f0c84a5f-ea48-4e18-9f74-d35f5d3f1a98 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765394 Aug 29 21:36:51.213338 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 467/974] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:51.224888 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-473d0f08-55f1-4f5c-accb-da8c33e7c2a8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:51.225663 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-473d0f08-55f1-4f5c-accb-da8c33e7c2a8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:51.284560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-473d0f08-55f1-4f5c-accb-da8c33e7c2a8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:51.291993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-473d0f08-55f1-4f5c-accb-da8c33e7c2a8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1214 microversion: 2.1 time: 0.071190 Aug 29 21:36:51.292559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 508/975] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:51 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:52.315022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:52.315980 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:52.324480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:52.324972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:52.325412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:52.326153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:52.326674 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:52.327052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:52.393539 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.401828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ca364ef5-9dd2-4c42-8294-5ea04d3e3a32 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1218 microversion: 2.1 time: 0.093055 Aug 29 21:36:52.402426 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 468/976] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:52 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:53.428321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:53.429036 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:53.441690 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.442094 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.442630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.443552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.444042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.444475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.519199 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.528185 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-808bcf69-ceae-40af-9e39-1de3303ea6e6 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1266 microversion: 2.1 time: 0.103592 Aug 29 21:36:53.528843 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 509/977] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:53 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:54.565564 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:54.566283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:54.571748 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:54.575589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.576141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.576585 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.577310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.577770 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.579639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.134749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:55.144424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-da77d8f1-ec88-49f0-aa0f-49bbac99febc tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1314 microversion: 2.1 time: 0.585827 Aug 29 21:36:55.145277 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 469/978] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:54 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:55.799213 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-9a3bbcaf-8cd1-4c4d-926f-f5bb7818b1d2 req-5f0d0298-32d5-45ae-aa68-1572b7c96464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b", "tag": "1e29ec51-a8c7-4257-a32e-2c73972c3379"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:55.811474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9a3bbcaf-8cd1-4c4d-926f-f5bb7818b1d2 req-5f0d0298-32d5-45ae-aa68-1572b7c96464 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.812127 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9a3bbcaf-8cd1-4c4d-926f-f5bb7818b1d2 req-5f0d0298-32d5-45ae-aa68-1572b7c96464 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.812564 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9a3bbcaf-8cd1-4c4d-926f-f5bb7818b1d2 req-5f0d0298-32d5-45ae-aa68-1572b7c96464 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.824911 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-9a3bbcaf-8cd1-4c4d-926f-f5bb7818b1d2 req-5f0d0298-32d5-45ae-aa68-1572b7c96464 service nova] Creating event network-changed:1e29ec51-a8c7-4257-a32e-2c73972c3379 for instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b on hv-cinder-85426 Aug 29 21:36:55.830284 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-9a3bbcaf-8cd1-4c4d-926f-f5bb7818b1d2 req-5f0d0298-32d5-45ae-aa68-1572b7c96464 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035212 Aug 29 21:36:55.831131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 510/979] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:56.172887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:56.174045 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:56.186634 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.187538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.188578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.189954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.190801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.191598 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.436366 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.443989 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3ef3630a-2e67-4e72-aca6-09952b0eb2bd tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1314 microversion: 2.1 time: 0.280534 Aug 29 21:36:56.444566 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 470/980] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:56 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:57.466508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:57.467097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:57.473526 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.474002 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.474433 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.475159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.475610 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.476102 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.614578 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:57.622460 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-51b708a6-f324-448f-93cf-7386a2e634c5 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1314 microversion: 2.1 time: 0.161177 Aug 29 21:36:57.623048 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 511/981] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:57 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:58.644126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:58.644716 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:58.650700 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.651172 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.651601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.654108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.654108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.654108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.790247 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:58.797977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ae03b157-efe4-4544-bf7a-5b9c8c5cc5ef tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1314 microversion: 2.1 time: 0.157905 Aug 29 21:36:58.798532 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 471/982] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:58 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:59.818759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:59.819396 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:59.822450 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:59.827336 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:59.827862 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:59.828323 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.829208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:59.829747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:59.830169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.966831 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.974823 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b8572dea-ebfe-43b7-a9d1-90afa570b459 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1314 microversion: 2.1 time: 0.159959 Aug 29 21:36:59.975377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 512/983] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:59 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:00.997274 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:00.997890 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:01.000427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:01.001108 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=6 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:01.005978 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.006454 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.006931 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.007630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.008713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.009140 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.154385 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:01.163219 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b4113cf1-a888-47e0-8893-4100cad01fa2 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1314 microversion: 2.1 time: 0.170401 Aug 29 21:37:01.163783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-9ecb3b83-c615-4ac9-98c6-81241df1ac87 req-d9d6dd3b-ee56-489a-bb6a-5801b838709f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b", "name": "network-vif-plugged", "status": "completed", "tag": "1e29ec51-a8c7-4257-a32e-2c73972c3379"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:01.164331 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 472/984] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:00 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:01.176712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9ecb3b83-c615-4ac9-98c6-81241df1ac87 req-d9d6dd3b-ee56-489a-bb6a-5801b838709f service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.177187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9ecb3b83-c615-4ac9-98c6-81241df1ac87 req-d9d6dd3b-ee56-489a-bb6a-5801b838709f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.177616 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9ecb3b83-c615-4ac9-98c6-81241df1ac87 req-d9d6dd3b-ee56-489a-bb6a-5801b838709f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.190621 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-9ecb3b83-c615-4ac9-98c6-81241df1ac87 req-d9d6dd3b-ee56-489a-bb6a-5801b838709f service nova] Creating event network-vif-plugged:1e29ec51-a8c7-4257-a32e-2c73972c3379 for instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b on hv-cinder-85426 Aug 29 21:37:01.196509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-9ecb3b83-c615-4ac9-98c6-81241df1ac87 req-d9d6dd3b-ee56-489a-bb6a-5801b838709f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035517 Aug 29 21:37:01.197117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 513/985] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:02.185145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:02.185777 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:02.192805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.193271 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.193704 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.194411 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.194863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.195289 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.335486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.344485 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e04a0385-cdd4-46a7-b9ee-bf8f112c221f tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1314 microversion: 2.1 time: 0.162878 Aug 29 21:37:02.345085 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 473/986] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:02 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:02.559439 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3362ab9f-b03f-46d6-aa26-31c1073e952f", "device": "/dev/sdb"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:02.562850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:02.565487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:02.572519 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.572519 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.573066 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.574033 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.574738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.575528 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.366152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:03.368922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:03.373689 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.374175 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.374615 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.375454 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.375934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.376366 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.527654 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:03.535639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-32d0f7dd-ff6e-4ddd-bd11-17e4781f403d tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1498 microversion: 2.1 time: 0.173410 Aug 29 21:37:03.536250 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 474/987] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:03 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:03.642620 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-13e13618-8b69-47f0-9975-827ca31e0140 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "POST /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.087739 Aug 29 21:37:03.643249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 514/988] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:37:02 2022] POST /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:04.544490 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:04.545065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:04.551721 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.552254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.552696 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:04.553403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.553855 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.554296 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:04.593490 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:37:04.967088 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-179befca-0b84-4932-8d08-2f4f5f743e30 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 204 len: 0 microversion: 2.1 time: 0.426195 Aug 29 21:37:04.967707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 475/989] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:37:04 2022] DELETE /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:37:04.977619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:04.978317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:04.984942 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.985427 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.985865 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:04.986563 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.987050 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.987501 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.139619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:05.147640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-635348b9-7bb1-4215-98f7-2054253fdb24 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1504 microversion: 2.1 time: 0.174774 Aug 29 21:37:05.148277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 515/990] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:04 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:06.169821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:06.170526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:06.176836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.177327 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.177761 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.178516 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.178988 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.179403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.322645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.330578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-85808662-367b-402c-bab6-4617f0b9f6f8 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1504 microversion: 2.1 time: 0.165036 Aug 29 21:37:06.331153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 476/991] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:06 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:07.353679 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:07.354299 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:07.362234 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.362726 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.363169 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.363895 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.364371 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.364797 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.502849 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.513291 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ef4e606a-458e-4d07-b795-a715c8fe28ae tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1504 microversion: 2.1 time: 0.165789 Aug 29 21:37:07.514083 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 516/992] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:07 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:07.824712 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-43316a5d-34ee-4663-8647-6efa28feae50 req-b2cc2ba9-a1c2-4fc5-a7bb-7dea6d68e308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b", "name": "network-vif-deleted", "tag": "1e29ec51-a8c7-4257-a32e-2c73972c3379"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:07.835766 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-43316a5d-34ee-4663-8647-6efa28feae50 req-b2cc2ba9-a1c2-4fc5-a7bb-7dea6d68e308 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.836764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-43316a5d-34ee-4663-8647-6efa28feae50 req-b2cc2ba9-a1c2-4fc5-a7bb-7dea6d68e308 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.837738 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-43316a5d-34ee-4663-8647-6efa28feae50 req-b2cc2ba9-a1c2-4fc5-a7bb-7dea6d68e308 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.849148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-43316a5d-34ee-4663-8647-6efa28feae50 req-b2cc2ba9-a1c2-4fc5-a7bb-7dea6d68e308 service nova] Creating event network-vif-deleted:1e29ec51-a8c7-4257-a32e-2c73972c3379 for instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b on hv-cinder-85426 Aug 29 21:37:07.855493 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-43316a5d-34ee-4663-8647-6efa28feae50 req-b2cc2ba9-a1c2-4fc5-a7bb-7dea6d68e308 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037862 Aug 29 21:37:07.856152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 477/993] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:08.534929 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:08.535545 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:08.542855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.543344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.543782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.544518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.544977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.545431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.577719 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.578226 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.578667 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.579119 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lazy-loading 'fault' on Instance uuid 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:08.626890 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee513b3ba1d545a696c08448370680e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233fa99a6f44783bdd72e14b28bf441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.636336 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-19439954-214c-4adb-98a3-19aea5224899 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 200 len: 1304 microversion: 2.1 time: 0.105188 Aug 29 21:37:08.637164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 517/994] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:08 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:09.660636 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:09.661348 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] [instance: 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:09.668381 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.668864 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.669298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.670020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.670468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.670914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.674150 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:09.686717 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] HTTP exception thrown: Instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b could not be found. Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Request method failure captured: Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b HTTP/1.1 Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTFZIqykfTKuaVtVCc-_V19ccg02xzkWLqbvd-0HVSPOIhTC-nXUCCQ-CPw16xAZRuGckqsDBNS0oXeZCC-6oLtlX51A5NUO4kxwDrIs6zo1ejjRndVJwESXEIfhfspk8hE7AFwER5bW_4tLgEZFfLMwLm_2iycyqKR2RpipAJMY_rM Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: b233fa99a6f44783bdd72e14b28bf441 Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesActionsTest-142771176 Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:37:09.688434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b233fa99a6f44783bdd72e14b28bf441"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b233fa99a6f44783bdd72e14b28bf441", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b233fa99a6f44783bdd72e14b28bf441"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b233fa99a6f44783bdd72e14b28bf441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesActionsTest-142771176 Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: b233fa99a6f44783bdd72e14b28bf441 Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesActionsTest-142771176 Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesActionsTest-142771176-project Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: ee513b3ba1d545a696c08448370680e5 Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesActionsTest-142771176-project Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b could not be found. Aug 29 21:37:09.694524 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b'} Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b could not be found. Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:09.695869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b could not be found. Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b could not be found. Aug 29 21:37:09.697254 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:09.698377 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] Returning 404 to user: Instance 9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:09.698377 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-794b78e6-128b-4eb8-b78c-767e672dca13 tempest-VolumesActionsTest-142771176 tempest-VolumesActionsTest-142771176-project] 10.222.0.65 "GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b" status: 404 len: 111 microversion: 2.1 time: 0.034307 Aug 29 21:37:09.698377 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 478/995] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:09 2022] GET /compute/v2.1/servers/9a2e72b0-8d9b-40d0-8cfe-c2ca20080f7b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:37:32.248146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:32.249201 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.252282 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=13 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:32.252961 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:32.254286 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:37:32.254630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Mon Aug 29 21:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501/os-volume_attachments/3362ab9f-b03f-46d6-aa26-31c1073e952f (ip 10.222.0.65) !!! Aug 29 21:37:32.262116 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.264801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.264801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.264801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.264801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.265278 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.413824 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lazy-loading 'services' on Instance uuid 47577035-d2fd-4b3b-859f-a21376bdc501 {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:32.727128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0332be00-6612-4bf4-8b5a-6250099897ae tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501/os-volume_attachments/3362ab9f-b03f-46d6-aa26-31c1073e952f" status: 202 len: 0 microversion: 2.1 time: 0.482053 Aug 29 21:37:32.727128 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 518/996] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:37:32 2022] DELETE /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501/os-volume_attachments/3362ab9f-b03f-46d6-aa26-31c1073e952f => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:37:35.082597 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.083577 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.088949 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:35.092513 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:37:35.093179 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Mon Aug 29 21:37:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 (ip 10.222.0.65) !!! Aug 29 21:37:35.111122 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.111653 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.112257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.113012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.113558 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.114147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.172886 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:37:35.601795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-592e39df-8ca2-447b-9a86-042281a5edfa tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 204 len: 0 microversion: 2.1 time: 0.524791 Aug 29 21:37:35.602403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 479/997] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:37:35 2022] DELETE /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:37:35.612618 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.614244 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.622493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.622988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.623432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.624440 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.625074 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.625677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.802506 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:35.816868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-92860ae0-0f8d-489e-9d3e-a0b2c40d4b7f tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1513 microversion: 2.1 time: 0.208100 Aug 29 21:37:35.818370 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 519/998] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:35 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:36.850580 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:36.851444 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:36.859213 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.860134 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.861162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.862217 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.862874 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.863482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:37.070629 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.085637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0a1c2b7d-7140-42ac-8e0e-91d783063fd3 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1513 microversion: 2.1 time: 0.239452 Aug 29 21:37:37.087012 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 480/999] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:36 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:38.118906 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:38.119858 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:38.128833 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.129259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.130029 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.130664 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.133740 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.133971 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.421940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:38.430987 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-9fa856bf-01a1-486b-a36b-bc2ce9921eeb tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1513 microversion: 2.1 time: 0.316549 Aug 29 21:37:38.445827 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 520/1000] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:38 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:39.009167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-cbc4d14f-d023-436f-888f-6c7193794560 req-ace8c168-b8c2-48fc-a724-6c75414ca196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47577035-d2fd-4b3b-859f-a21376bdc501", "name": "network-vif-deleted", "tag": "028b4efd-3a98-4e9f-b5ce-441d012207a9"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:39.024143 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-cbc4d14f-d023-436f-888f-6c7193794560 req-ace8c168-b8c2-48fc-a724-6c75414ca196 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.024875 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-cbc4d14f-d023-436f-888f-6c7193794560 req-ace8c168-b8c2-48fc-a724-6c75414ca196 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.025467 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-cbc4d14f-d023-436f-888f-6c7193794560 req-ace8c168-b8c2-48fc-a724-6c75414ca196 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.040498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-cbc4d14f-d023-436f-888f-6c7193794560 req-ace8c168-b8c2-48fc-a724-6c75414ca196 service nova] Creating event network-vif-deleted:028b4efd-3a98-4e9f-b5ce-441d012207a9 for instance 47577035-d2fd-4b3b-859f-a21376bdc501 on hv-cinder-85426 Aug 29 21:37:39.046687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-cbc4d14f-d023-436f-888f-6c7193794560 req-ace8c168-b8c2-48fc-a724-6c75414ca196 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137488 Aug 29 21:37:39.051753 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 481/1001] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:39.452936 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:39.453560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:39.461104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.461595 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.462032 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.462759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.463427 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.463925 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.500117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.500603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.501038 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.503488 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lazy-loading 'fault' on Instance uuid 47577035-d2fd-4b3b-859f-a21376bdc501 {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:39.557604 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:39.566469 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-f19a99ba-c59d-42ed-a7c0-54ba4882fb68 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 200 len: 1309 microversion: 2.1 time: 0.117462 Aug 29 21:37:39.567115 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 521/1002] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:39 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:40.591279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:40.592072 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 47577035-d2fd-4b3b-859f-a21376bdc501] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:40.599314 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.599805 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.600273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.600990 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.601440 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.601865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.619310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] HTTP exception thrown: Instance 47577035-d2fd-4b3b-859f-a21376bdc501 could not be found. Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Request method failure captured: Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 HTTP/1.1 Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTFVfWtkje-PSHRgtUWs702KyIuqMymOk6mOYvsR1lFJBA_T3XXLegRjMqNXHYRXr5yrkP6oWuRgumIfix5hNVm-K1_cMH_hUAbrFN3y7WlEM02G2rT2jsBngAz_d3Zir5qwaiRU2wZtvNO6J8P1ZA95Q6zoi2ZDJ5rny_tyGWtBpfY Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 2113bed9d7c04c4691ff173ac0f3d75a Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-VolumesSnapshotTestJSON-575288833 Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:37:40.622198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2113bed9d7c04c4691ff173ac0f3d75a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2113bed9d7c04c4691ff173ac0f3d75a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2113bed9d7c04c4691ff173ac0f3d75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2113bed9d7c04c4691ff173ac0f3d75a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-VolumesSnapshotTestJSON-575288833 Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 2113bed9d7c04c4691ff173ac0f3d75a Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-575288833 Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-VolumesSnapshotTestJSON-575288833-project Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: cce4a98431d74dd5a6494214d0d1188e Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-VolumesSnapshotTestJSON-575288833-project Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 47577035-d2fd-4b3b-859f-a21376bdc501 could not be found. Aug 29 21:37:40.625169 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '47577035-d2fd-4b3b-859f-a21376bdc501'} Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47577035-d2fd-4b3b-859f-a21376bdc501 could not be found. Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:40.628284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47577035-d2fd-4b3b-859f-a21376bdc501 could not be found. Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47577035-d2fd-4b3b-859f-a21376bdc501 could not be found. Aug 29 21:37:40.632435 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.635216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Returning 404 to user: Instance 47577035-d2fd-4b3b-859f-a21376bdc501 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:40.635216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-358e6c46-7b0e-4e39-9ae3-19950d28610c tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501" status: 404 len: 111 microversion: 2.1 time: 0.039784 Aug 29 21:37:40.635216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 482/1003] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:40 2022] GET /compute/v2.1/servers/47577035-d2fd-4b3b-859f-a21376bdc501 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:37:51.507542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-631180176", "imageRef": "1fd82a64-6b2f-4e7e-90e7-ae954025c688", "flavorRef": "452", "networks": [{"uuid": "9529232b-4c61-4df9-b4c2-2920904b6b0d"}]}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:51.516995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=10 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:51.517668 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:51.564073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.network.neutron [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] validate_networks() for [('9529232b-4c61-4df9-b4c2-2920904b6b0d', None, None, None, None, None)] {{(pid=121558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:37:52.063696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Flavor limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:37:52.064387 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Image limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:37:52.064982 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Flavor pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:37:52.065542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Image pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:37:52.066243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:37:52.077932 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.078416 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.078874 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.079607 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.080100 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.080528 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.099317 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Getting quotas for project 2113bed9d7c04c4691ff173ac0f3d75a. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:37:52.104910 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Getting quotas for user cce4a98431d74dd5a6494214d0d1188e and project 2113bed9d7c04c4691ff173ac0f3d75a. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:37:52.119644 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Going to run 1 instances... {{(pid=121558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:37:52.122163 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1fd82a64-6b2f-4e7e-90e7-ae954025c688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:37:52.296004 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-db99d718-1814-4421-867e-058ef263e4d5 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792486 Aug 29 21:37:52.296587 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 522/1004] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:37:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:37:52.312710 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-63fa7e54-a86f-4ead-8753-ece2099cea94 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:52.314607 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-63fa7e54-a86f-4ead-8753-ece2099cea94 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:52.317839 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:52.319201 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:52.386015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-63fa7e54-a86f-4ead-8753-ece2099cea94 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.394001 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-63fa7e54-a86f-4ead-8753-ece2099cea94 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1218 microversion: 2.1 time: 0.086554 Aug 29 21:37:52.394664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 483/1005] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:52 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:53.417992 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c1d0b9f1-20d2-49ce-ac76-4f364fa0ca30 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:53.418690 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c1d0b9f1-20d2-49ce-ac76-4f364fa0ca30 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:53.474802 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c1d0b9f1-20d2-49ce-ac76-4f364fa0ca30 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:53.484507 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c1d0b9f1-20d2-49ce-ac76-4f364fa0ca30 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1218 microversion: 2.1 time: 0.071050 Aug 29 21:37:53.485204 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 523/1006] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:53 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:54.508943 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:54.509971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:54.524317 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.524945 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.525484 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.526310 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.526893 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.527419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.600432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.608627 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-726f670d-780a-4b31-bf09-a247a1a51e72 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1270 microversion: 2.1 time: 0.106911 Aug 29 21:37:54.609213 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 484/1007] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:54 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:55.629738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:55.630453 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:55.638937 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.639576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.640142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.646206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.646206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.646206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.718894 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:55.728949 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-59250ff5-9ec3-490b-9bc4-bb995811561b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1278 microversion: 2.1 time: 0.103230 Aug 29 21:37:55.729540 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 524/1008] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:55 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:56.755464 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:56.756166 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:56.763369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.765260 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.765260 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.765260 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.765555 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.765994 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.008069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.016707 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5f3364f6-5239-4cda-b68f-b1c069d6e258 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.269694 Aug 29 21:37:57.017460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 485/1009] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:56 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:57.548103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-5d4d84f2-261f-4c57-831b-1fd62d2308e0 req-8713b73b-d5bb-45a2-85ae-15218e833006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64154da7-87bb-439b-ae3c-9139e69003aa", "tag": "255a541b-a01d-4430-a01d-ae76eeb87270"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:57.559540 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5d4d84f2-261f-4c57-831b-1fd62d2308e0 req-8713b73b-d5bb-45a2-85ae-15218e833006 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.560333 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5d4d84f2-261f-4c57-831b-1fd62d2308e0 req-8713b73b-d5bb-45a2-85ae-15218e833006 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.561069 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5d4d84f2-261f-4c57-831b-1fd62d2308e0 req-8713b73b-d5bb-45a2-85ae-15218e833006 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.579673 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-5d4d84f2-261f-4c57-831b-1fd62d2308e0 req-8713b73b-d5bb-45a2-85ae-15218e833006 service nova] Creating event network-changed:255a541b-a01d-4430-a01d-ae76eeb87270 for instance 64154da7-87bb-439b-ae3c-9139e69003aa on hv-cinder-85426 Aug 29 21:37:57.586605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-5d4d84f2-261f-4c57-831b-1fd62d2308e0 req-8713b73b-d5bb-45a2-85ae-15218e833006 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042298 Aug 29 21:37:57.587559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 525/1010] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:58.039043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:58.039694 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:58.046752 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.047239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.047678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.048438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.048957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.049314 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.293668 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:58.303847 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ccffa163-0247-41d7-b2f9-6b21e2a76d9d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.268751 Aug 29 21:37:58.304405 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 486/1011] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:58 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:59.327856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:59.328686 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:59.335372 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.335854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.336315 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.337058 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.337506 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.337988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.505979 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.519481 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-91e8718a-0c44-4f40-b713-ea712e148054 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.196601 Aug 29 21:37:59.520511 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 526/1012] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:59 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:00.553403 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:00.553968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:00.560801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.561284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.561715 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.562412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.562861 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.563282 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.710729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.718924 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c78c4a75-cb4b-41db-8753-aef977ad96e2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.170172 Aug 29 21:38:00.719778 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 487/1013] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:00 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:01.742976 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:01.743853 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:01.751800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.752332 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.752775 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.753612 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.754041 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.754494 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.959348 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:01.968883 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e823b30d-1752-4359-83fc-47e88c9c8e32 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.230860 Aug 29 21:38:01.969476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 527/1014] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:01 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:03.004503 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:03.005243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:03.008502 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:03.014043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.014531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.014971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.015691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.016227 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.016656 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.188378 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.203378 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b99d84c0-7c26-4afa-ad91-c5c50b49a0e0 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.203252 Aug 29 21:38:03.204015 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 488/1015] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:02 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:03.652211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:03.654035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=8 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:03.847717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-de36cd2c-a3c9-4caf-9a88-0fbfae8fbf17 req-14fecdc5-9104-408a-9a0c-d7473429291c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64154da7-87bb-439b-ae3c-9139e69003aa", "name": "network-vif-plugged", "status": "completed", "tag": "255a541b-a01d-4430-a01d-ae76eeb87270"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:03.860435 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-de36cd2c-a3c9-4caf-9a88-0fbfae8fbf17 req-14fecdc5-9104-408a-9a0c-d7473429291c service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.861283 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-de36cd2c-a3c9-4caf-9a88-0fbfae8fbf17 req-14fecdc5-9104-408a-9a0c-d7473429291c service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.862053 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-de36cd2c-a3c9-4caf-9a88-0fbfae8fbf17 req-14fecdc5-9104-408a-9a0c-d7473429291c service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.879439 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-de36cd2c-a3c9-4caf-9a88-0fbfae8fbf17 req-14fecdc5-9104-408a-9a0c-d7473429291c service nova] Creating event network-vif-plugged:255a541b-a01d-4430-a01d-ae76eeb87270 for instance 64154da7-87bb-439b-ae3c-9139e69003aa on hv-cinder-85426 Aug 29 21:38:03.885188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-de36cd2c-a3c9-4caf-9a88-0fbfae8fbf17 req-14fecdc5-9104-408a-9a0c-d7473429291c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237701 Aug 29 21:38:03.897386 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 528/1016] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:04.227004 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:04.227623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:04.234984 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.235471 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.235993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.236769 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.237222 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.237645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.414559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:04.423548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8f7f6d36-b1ee-44f9-8d5d-d19719d8818d tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.200859 Aug 29 21:38:04.424223 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 489/1017] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:04 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:05.446552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:05.447368 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:05.453556 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.454037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.454501 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.455202 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.455643 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.456094 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.597477 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:05.605968 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-34917456-e63f-410c-872b-34f1c931ea55 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1318 microversion: 2.1 time: 0.164288 Aug 29 21:38:05.606550 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 529/1018] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:05 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:06.626079 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:06.644997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:06.644997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.644997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.644997 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.645422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.645422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.645422 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.774727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:06.783324 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-d78c6e43-e335-4123-900a-35e653e73944 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1506 microversion: 2.1 time: 0.161273 Aug 29 21:38:06.783930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 490/1019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:06 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:06.804152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f8707bf-9c84-4445-b51c-0007f8c645ca", "device": "/dev/sdb"}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:06.806562 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:06.812914 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.813390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.813818 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.814501 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.814948 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.815658 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.950700 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-78f54897-b9f9-441f-87fe-a38509b34460 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "POST /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.150013 Aug 29 21:38:07.951728 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 530/1020] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Aug 29 21:38:06 2022] POST /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa/os-volume_attachments => generated 194 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:28.499052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:28.499668 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:28.501940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=18 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.502583 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=42 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.508257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.508793 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.509223 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.509968 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.510451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.511103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.616934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lazy-loading 'services' on Instance uuid 64154da7-87bb-439b-ae3c-9139e69003aa {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:29.081895 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4ba4ce13-3fa1-4680-b6c6-327a64d1725b tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa/os-volume_attachments/8f8707bf-9c84-4445-b51c-0007f8c645ca" status: 202 len: 0 microversion: 2.1 time: 0.588056 Aug 29 21:38:29.082563 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 491/1021] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Aug 29 21:38:28 2022] DELETE /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa/os-volume_attachments/8f8707bf-9c84-4445-b51c-0007f8c645ca => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:38:30.232426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:30.233268 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:30.237515 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:30.238099 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:30.244881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.245367 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.245805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.246506 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.246965 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.247392 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.276790 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:38:30.678774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d89c17a2-303f-44af-b4f4-2403cdc36783 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 204 len: 0 microversion: 2.1 time: 0.447212 Aug 29 21:38:30.679738 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 531/1022] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:38:30 2022] DELETE /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:38:30.691898 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:30.693020 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:30.703417 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.704232 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.704916 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.706028 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.706774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.707443 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.880854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:30.890228 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-47278efa-2266-4bdf-887a-72149bb87fa1 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1512 microversion: 2.1 time: 0.205501 Aug 29 21:38:30.890827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 492/1023] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:30 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:31.915712 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:31.917109 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:31.927267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.927763 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.928242 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.929014 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.929472 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.929898 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.103149 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:32.111439 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-494df9b3-b1cd-470a-92a7-50720ed52825 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1512 microversion: 2.1 time: 0.202524 Aug 29 21:38:32.112051 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 532/1024] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:31 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:33.140244 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:33.140895 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:33.159363 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.159363 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.159363 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.159363 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.161120 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.161120 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.226461 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-eca91cc5-0e05-4d58-a9f4-5cff69b12067 req-f59bf9d6-08a1-4c8c-b17e-14174774d7ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64154da7-87bb-439b-ae3c-9139e69003aa", "name": "network-vif-deleted", "tag": "255a541b-a01d-4430-a01d-ae76eeb87270"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:33.246639 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-eca91cc5-0e05-4d58-a9f4-5cff69b12067 req-f59bf9d6-08a1-4c8c-b17e-14174774d7ba service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.247394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-eca91cc5-0e05-4d58-a9f4-5cff69b12067 req-f59bf9d6-08a1-4c8c-b17e-14174774d7ba service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.248253 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-eca91cc5-0e05-4d58-a9f4-5cff69b12067 req-f59bf9d6-08a1-4c8c-b17e-14174774d7ba service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.254170 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:33.263624 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-67a5028e-36fe-49f1-a8ce-afd756e5b799 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1470 microversion: 2.1 time: 0.129957 Aug 29 21:38:33.264234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 493/1025] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:33 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1470 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:33.270410 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-eca91cc5-0e05-4d58-a9f4-5cff69b12067 req-f59bf9d6-08a1-4c8c-b17e-14174774d7ba service nova] Creating event network-vif-deleted:255a541b-a01d-4430-a01d-ae76eeb87270 for instance 64154da7-87bb-439b-ae3c-9139e69003aa on hv-cinder-85426 Aug 29 21:38:33.276601 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-eca91cc5-0e05-4d58-a9f4-5cff69b12067 req-f59bf9d6-08a1-4c8c-b17e-14174774d7ba service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056326 Aug 29 21:38:33.277238 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 533/1026] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:34.299040 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:34.299922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:34.309043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.309650 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.310147 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.311029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.311623 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.312239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.354049 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.354526 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.354955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.355399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lazy-loading 'fault' on Instance uuid 64154da7-87bb-439b-ae3c-9139e69003aa {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:34.414926 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce4a98431d74dd5a6494214d0d1188e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113bed9d7c04c4691ff173ac0f3d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:34.426705 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-31a0811f-c379-4702-b128-4ff5e9697d10 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 200 len: 1308 microversion: 2.1 time: 0.132221 Aug 29 21:38:34.427818 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 494/1027] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:34 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:35.451338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:35.452003 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] [instance: 64154da7-87bb-439b-ae3c-9139e69003aa] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:35.459029 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:35.459521 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:35.460580 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:35.461425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:35.462001 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:35.462338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:35.479663 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] HTTP exception thrown: Instance 64154da7-87bb-439b-ae3c-9139e69003aa could not be found. Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Request method failure captured: Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa HTTP/1.1 Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTFVfWtkje-PSHRgtUWs702KyIuqMymOk6mOYvsR1lFJBA_T3XXLegRjMqNXHYRXr5yrkP6oWuRgumIfix5hNVm-K1_cMH_hUAbrFN3y7WlEM02G2rT2jsBngAz_d3Zir5qwaiRU2wZtvNO6J8P1ZA95Q6zoi2ZDJ5rny_tyGWtBpfY Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 2113bed9d7c04c4691ff173ac0f3d75a Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-VolumesSnapshotTestJSON-575288833 Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:38:35.482179 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2113bed9d7c04c4691ff173ac0f3d75a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2113bed9d7c04c4691ff173ac0f3d75a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2113bed9d7c04c4691ff173ac0f3d75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2113bed9d7c04c4691ff173ac0f3d75a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-VolumesSnapshotTestJSON-575288833 Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 2113bed9d7c04c4691ff173ac0f3d75a Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-575288833 Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-VolumesSnapshotTestJSON-575288833-project Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: cce4a98431d74dd5a6494214d0d1188e Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-VolumesSnapshotTestJSON-575288833-project Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance 64154da7-87bb-439b-ae3c-9139e69003aa could not be found. Aug 29 21:38:35.485103 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': '64154da7-87bb-439b-ae3c-9139e69003aa'} Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64154da7-87bb-439b-ae3c-9139e69003aa could not be found. Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:35.486560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64154da7-87bb-439b-ae3c-9139e69003aa could not be found. Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64154da7-87bb-439b-ae3c-9139e69003aa could not be found. Aug 29 21:38:35.489302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:38:35.492164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] Returning 404 to user: Instance 64154da7-87bb-439b-ae3c-9139e69003aa could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:35.492164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-43d095af-edab-41f6-9a89-ac85a78085b2 tempest-VolumesSnapshotTestJSON-575288833 tempest-VolumesSnapshotTestJSON-575288833-project] 10.222.0.65 "GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa" status: 404 len: 111 microversion: 2.1 time: 0.038153 Aug 29 21:38:35.492164 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 534/1028] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:35 2022] GET /compute/v2.1/servers/64154da7-87bb-439b-ae3c-9139e69003aa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:38:43.883462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:43.884481 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:43.890306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:43.892760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:43.892760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:43.892760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:43.892760 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:43.893132 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:43.920482 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lazy-loading 'flavor' on Instance uuid 0be1edde-e1cc-4d22-a11b-a050e511161e {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:44.234644 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2836821f-5844-4230-90ea-41d733d91028 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "POST /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e/action" status: 202 len: 0 microversion: 2.1 time: 0.355562 Aug 29 21:38:44.235497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 495/1029] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:38:43 2022] POST /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:38:44.244758 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:44.245507 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:44.253258 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:44.253758 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:44.254531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:44.255157 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:44.255626 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:44.256095 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:44.418609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:44.430443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-002f3074-f3a5-40f6-b36b-aee3463f0cc5 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.189787 Aug 29 21:38:44.431043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 535/1030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:44 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:45.454064 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:45.454684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:45.461058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:45.461548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:45.462008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:45.463009 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:45.463413 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:45.463834 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:45.626713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:45.635922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f4fb8d2a-888f-47a6-812e-24c2728064c0 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.186502 Aug 29 21:38:45.636561 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 496/1031] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:45 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:46.659331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:46.659947 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:46.666732 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.667246 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.667696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.668465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.668988 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.669417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.821208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:46.835390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-80228c79-088d-4586-b721-504b6f11838b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.180571 Aug 29 21:38:46.836489 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 536/1032] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:46 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:47.872675 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:47.873529 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:47.880394 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.880884 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.881368 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.882076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.882531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.882954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:48.056402 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:48.066243 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b5eb1f72-a611-4a49-a846-b9353aceae95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.197421 Aug 29 21:38:48.066831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 497/1033] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:47 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:49.088542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:49.089186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:49.097113 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:49.097687 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:49.098126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:49.098854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:49.099343 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:49.099764 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:49.257600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:49.266081 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-942c568a-6310-4453-bda1-47bdb1f156be tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.181666 Aug 29 21:38:49.266695 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 537/1034] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:49 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:50.287078 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:50.288257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:50.295447 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:50.295959 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:50.296407 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:50.297131 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:50.297586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:50.298008 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:50.454972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:50.463830 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1de77943-5503-4bc0-909c-8527bc26fd09 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.180720 Aug 29 21:38:50.471298 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 498/1035] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:50 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:51.491131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:51.491741 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:51.498447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:51.498865 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:51.499302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:51.500045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:51.500496 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:51.500919 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:51.649687 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:51.658157 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-713f0353-b3e6-401c-8cce-3261ff177179 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.171341 Aug 29 21:38:51.658743 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 538/1036] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:51 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:52.680893 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:52.681557 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:52.689167 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:52.689680 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:52.690100 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:52.690814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:52.691264 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:52.691682 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:52.837531 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:52.846283 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-637c6bbb-e0d6-4839-aa39-f360bb10829a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.169967 Aug 29 21:38:52.846877 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 499/1037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:52 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:53.868272 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:53.868923 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:53.875737 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:53.876481 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:53.877132 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:53.877854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:53.878306 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:53.878722 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:54.032609 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:54.042305 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b5870f73-1bcd-4e40-b1f5-cdce05f227fb tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.178800 Aug 29 21:38:54.042962 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 539/1038] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:53 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:55.066038 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:55.066726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:55.074588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.075069 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.075553 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.076291 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.076840 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.077272 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.247796 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:55.257423 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1cba47e0-6c4f-4fda-8628-2414a912cefc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.196265 Aug 29 21:38:55.258022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 500/1039] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:55 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:56.279569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:56.280206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:56.286758 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.287255 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.287688 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.288415 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.288865 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.296190 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.435251 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:56.444018 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-368512cf-207e-4af4-9c96-760423ccba48 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.168076 Aug 29 21:38:56.444637 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 540/1040] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:56 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:57.465458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:57.466066 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:57.472458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.474515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.474515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.474515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.474515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.475634 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.626787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:57.635130 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-fbc35817-c31f-4d02-9d28-d44ea7c89f25 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.173878 Aug 29 21:38:57.635750 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 501/1041] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:57 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:58.656788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:58.657436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:58.664865 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.665499 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.665976 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.666706 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.667165 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.667582 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.805140 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:58.813052 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-44441199-a146-4d7b-957b-e67d11cb31fd tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1506 microversion: 2.1 time: 0.160279 Aug 29 21:38:58.813646 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 541/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:58 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:58.834790 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:58.835585 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:58.837671 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=25 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:58.843067 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.843562 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.844038 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.844789 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.845510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.845942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.880402 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121559) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:38:59.091257 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:59.315581 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5e1cc849-109b-4e09-bd45-c0cf805d57ba tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "POST /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e/action" status: 202 len: 0 microversion: 2.1 time: 0.485677 Aug 29 21:38:59.316240 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 502/1043] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Aug 29 21:38:58 2022] POST /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:38:59.325377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.326024 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.332254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.332683 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.333114 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.333847 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.334830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.335249 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.477786 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:59.495180 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-241111b9-9399-46f9-86f6-88260e0ae23b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1514 microversion: 2.1 time: 0.173748 Aug 29 21:38:59.495901 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 542/1044] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:59 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:00.520144 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:00.520803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:00.527500 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.528021 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.528462 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.529164 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.532869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.532869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.691691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:00.701935 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-36f54a5e-3cf9-40b3-9e58-56c055a451ad tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1514 microversion: 2.1 time: 0.188755 Aug 29 21:39:00.702924 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 503/1045] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:00 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:01.707053 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-66bd569e-53a8-4ad5-b8f6-58f1d5455048 req-9d3f9a0e-360b-4d66-9f2b-acfd14125a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be1edde-e1cc-4d22-a11b-a050e511161e", "name": "network-vif-unplugged", "status": "completed", "tag": "a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:01.713490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:01.720759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-66bd569e-53a8-4ad5-b8f6-58f1d5455048 req-9d3f9a0e-360b-4d66-9f2b-acfd14125a43 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.721254 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-66bd569e-53a8-4ad5-b8f6-58f1d5455048 req-9d3f9a0e-360b-4d66-9f2b-acfd14125a43 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.721692 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-66bd569e-53a8-4ad5-b8f6-58f1d5455048 req-9d3f9a0e-360b-4d66-9f2b-acfd14125a43 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.726100 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:01.727418 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:01.734267 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.734770 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.734954 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.compute.server_external_events [req-66bd569e-53a8-4ad5-b8f6-58f1d5455048 req-9d3f9a0e-360b-4d66-9f2b-acfd14125a43 service nova] Unable to find a host for instance 0be1edde-e1cc-4d22-a11b-a050e511161e. Dropping event network-vif-unplugged {{(pid=121558) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 21:39:01.735282 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.735850 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-66bd569e-53a8-4ad5-b8f6-58f1d5455048 req-9d3f9a0e-360b-4d66-9f2b-acfd14125a43 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032812 Aug 29 21:39:01.736029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.736392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.736508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 543/1046] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 29 21:39:01.736809 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.902679 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:01.911311 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a91e00af-3d89-4623-b5fc-61c26eb16f95 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1516 microversion: 2.1 time: 0.190219 Aug 29 21:39:01.912468 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 504/1047] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:01 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:02.935119 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:02.935697 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:02.945435 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:02.945921 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:02.946353 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:02.947053 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:02.947559 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:02.948012 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:02.951009 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:03.134155 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:03.145092 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0d70eca6-c325-4f57-b9d5-edf195fa808a tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.212258 Aug 29 21:39:03.147584 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 544/1048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:02 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:04.172459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:04.173905 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:04.186967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.187988 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.188810 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.190365 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.191216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.191856 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.345576 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:04.354789 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-10f779af-8340-486c-a52f-c691f0622fe3 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.190887 Aug 29 21:39:04.355392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 505/1049] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:04 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:05.377244 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:05.377801 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:05.386035 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:05.386567 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:05.386999 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:05.387720 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:05.388206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:05.388750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:05.567212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:05.573124 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1b2999a8-06e2-4646-80ec-eb1e4de2fda4 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.199965 Aug 29 21:39:05.573754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 545/1050] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:05 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:06.595416 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:06.596103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:06.603459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.603986 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.604424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.605152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.605605 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.606029 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.763465 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:06.778730 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-7921b12c-b8fc-4dd2-8953-415b6662525c tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.187328 Aug 29 21:39:06.779803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 506/1051] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:06 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:07.808960 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:07.810208 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:07.817073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.823977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.823977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.823977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.823977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.824401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.955852 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:07.964490 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b01df84f-3971-4222-922b-2c8222c59585 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.159482 Aug 29 21:39:07.969233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 546/1052] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:07 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:08.986795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:08.987374 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:08.994016 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:08.994498 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:08.994955 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:08.995658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:08.996138 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:08.996667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:09.151981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:09.159226 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-0c5a38bb-b510-46e0-a395-62d27ea9eac2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.176459 Aug 29 21:39:09.159817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 507/1053] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:08 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:10.181192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:10.181778 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:10.188417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:10.188926 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:10.190297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:10.190297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:10.190724 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:10.191006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:10.336329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:10.344113 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-5fe2a91b-9ff0-4388-af63-e63d9b731225 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.166983 Aug 29 21:39:10.344677 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 547/1054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:10 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:11.365412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:11.366449 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:11.372962 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.373454 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.373893 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.374604 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.375059 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.375512 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.530596 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:11.538774 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-570f9200-947b-4637-915c-4674356e3d4f tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.177266 Aug 29 21:39:11.539779 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 508/1055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:11 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:12.561817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:12.562476 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:12.564876 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:39:12.565037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Mon Aug 29 21:39:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e (ip 10.222.0.65) !!! Aug 29 21:39:12.572742 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.573228 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.573662 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.574387 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.574840 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.575270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.722782 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:12.730638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-34fb6bf9-4ba4-4586-b5c9-8d8805d69f59 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.172807 Aug 29 21:39:12.731210 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 548/1056] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:12 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:13.760892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:13.762374 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:13.775001 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.775861 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.776657 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.777870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.778686 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.779712 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.940404 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.949448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8d0e012c-ec50-447c-ae04-39615d4638f1 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.197287 Aug 29 21:39:13.953161 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 509/1057] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:13 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:14.973683 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:14.974269 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:14.982224 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.982715 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.983145 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.983856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.984336 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.984766 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.126402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:15.137106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-df378ac4-6d04-4819-b856-6ee546b93d3e tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.167501 Aug 29 21:39:15.137933 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 549/1058] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:14 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:15.842074 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-542f6491-142f-4db9-80e1-589ca35f12ef req-8103a13e-1a7b-42e9-a11d-25d7fa86690f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be1edde-e1cc-4d22-a11b-a050e511161e", "name": "network-vif-plugged", "status": "completed", "tag": "a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:15.864239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-542f6491-142f-4db9-80e1-589ca35f12ef req-8103a13e-1a7b-42e9-a11d-25d7fa86690f service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.865429 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-542f6491-142f-4db9-80e1-589ca35f12ef req-8103a13e-1a7b-42e9-a11d-25d7fa86690f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.865969 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-542f6491-142f-4db9-80e1-589ca35f12ef req-8103a13e-1a7b-42e9-a11d-25d7fa86690f service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.878187 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-542f6491-142f-4db9-80e1-589ca35f12ef req-8103a13e-1a7b-42e9-a11d-25d7fa86690f service nova] Creating event network-vif-plugged:a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305 for instance 0be1edde-e1cc-4d22-a11b-a050e511161e on hv-cinder-85426 Aug 29 21:39:15.883519 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-542f6491-142f-4db9-80e1-589ca35f12ef req-8103a13e-1a7b-42e9-a11d-25d7fa86690f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045093 Aug 29 21:39:15.884328 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 510/1059] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:16.159294 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:16.160063 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:16.166828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.167314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.167747 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.168708 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.169334 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.169761 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.319827 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:16.327703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-84bbebf5-23f6-434a-856c-0035219b4db9 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.172556 Aug 29 21:39:16.328307 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 550/1060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:16 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:17.351839 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:17.352578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:17.361397 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.361889 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.362320 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.363233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.363695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.364141 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.512778 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:17.522934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-bccb7a40-1674-4e72-bf54-441cfad3198b tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1572 microversion: 2.1 time: 0.176929 Aug 29 21:39:17.523832 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 511/1061] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:17 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1572 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:18.544972 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:18.545727 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:18.552967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.553403 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.553860 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.554579 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.555042 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.555504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.696404 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:18.704800 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1cca0134-abbf-457e-a1a6-f993776d3d78 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1559 microversion: 2.1 time: 0.163811 Aug 29 21:39:18.705447 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 551/1062] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:18 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:31.807139 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:31.808024 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:32.062675 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-489226d1-1492-4288-b634-06281e877388 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Action: 'create', calling method: .version_select at 0x7fc8405cc0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1734531656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY7hKUDmpbfsGruAtxzzRxug2YdjQirIQfMM+gx1piq637hUv8mIiE5B8PYAmf3Dhh4g6+EdNtfRREHxkTuyuvBBx3x5XmfFmlMXdE5xUdNtYZMIEoFVJUE3YDzwUBvTQ=="}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:32.078966 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-489226d1-1492-4288-b634-06281e877388 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for project 77472ffae4da491881e41c08aa09e4fc. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:32.083225 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-489226d1-1492-4288-b634-06281e877388 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for user 0d57f52dc9044a259e6acbde81ac0476 and project 77472ffae4da491881e41c08aa09e4fc. Resources: {'key_pairs'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:32.179927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-489226d1-1492-4288-b634-06281e877388 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.378898 Aug 29 21:39:32.180640 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 512/1063] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Aug 29 21:39:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:53.387380 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-644400791", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1734531656", "security_groups": [{"name": "tempest-secgroup-smoke-1944143218"}], "block_device_mapping_v2": [{"uuid": "5e661897-0b4e-45d2-a7eb-4ef1b01d74be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "526ac953-2d63-4bf1-8bf8-4e48840fae3d"}]}} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:53.398417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=17 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:53.400953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=47 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:53.516962 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.network.neutron [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] validate_networks() for [('526ac953-2d63-4bf1-8bf8-4e48840fae3d', None, None, None, None, None)] {{(pid=121558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:39:53.932203 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Flavor limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:39:53.932659 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Image limits 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:39:53.933158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Flavor pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:39:53.933569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Image pref 0:0:0 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:39:53.933977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.virt.hardware [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:39:53.943302 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:53.943820 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:53.944283 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:53.945032 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:53.945466 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:53.945887 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:53.964404 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for project 77472ffae4da491881e41c08aa09e4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:53.968953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.quota [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for user 0d57f52dc9044a259e6acbde81ac0476 and project 77472ffae4da491881e41c08aa09e4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=121558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:54.033111 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Going to run 1 instances... {{(pid=121558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:39:54.035995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e661897-0b4e-45d2-a7eb-4ef1b01d74be',volume_size=None,volume_type=None)] {{(pid=121558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:39:54.636993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-2085f515-466a-4e28-887f-ef56e2930c14 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.253809 Aug 29 21:39:54.638104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 552/1064] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:39:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:39:54.646514 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=4 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:54.647287 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:54.651548 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6141f0c8-922d-42e9-8e5e-fc4d5c16e587 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:54.652173 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6141f0c8-922d-42e9-8e5e-fc4d5c16e587 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:54.710369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6141f0c8-922d-42e9-8e5e-fc4d5c16e587 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:54.719087 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6141f0c8-922d-42e9-8e5e-fc4d5c16e587 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1094 microversion: 2.1 time: 0.073807 Aug 29 21:39:54.719680 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 513/1065] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:54 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:55.741576 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-62eee7e1-d534-40d7-9989-2c92f3c94f3d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:55.742181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-62eee7e1-d534-40d7-9989-2c92f3c94f3d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:55.803941 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-62eee7e1-d534-40d7-9989-2c92f3c94f3d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:55.811176 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-62eee7e1-d534-40d7-9989-2c92f3c94f3d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1094 microversion: 2.1 time: 0.074550 Aug 29 21:39:55.811756 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 553/1066] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:55 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:56.833374 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:56.834000 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:56.841590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:56.842081 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:56.842515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:56.843225 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:56.843669 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:56.844137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:56.914799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:56.922977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-04bce8ef-db5d-4719-ab29-59cedc09474b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1192 microversion: 2.1 time: 0.094525 Aug 29 21:39:56.923568 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 514/1067] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:56 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:57.947642 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:57.948421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:57.957427 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:57.958296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:57.958763 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:57.959795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:57.960331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:57.961320 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.061475 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:58.071451 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-16b59217-d1d8-40c9-a85b-48c754a469d9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1210 microversion: 2.1 time: 0.130407 Aug 29 21:39:58.072096 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 554/1068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:57 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:59.099436 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:59.100622 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:59.108603 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.109252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.109764 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.110554 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.111087 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.111582 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.277934 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:59.283332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e640a9f5-2bc7-458a-af3d-f4e799a49310 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.189185 Aug 29 21:39:59.283925 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 515/1069] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:59 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:59.373830 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-5cdbbd15-8874-431b-84b0-62139801f20f req-e840b8c1-8496-4e55-99cf-260d688b2e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdda6e45-0167-46da-96c8-2d23ee9767db", "tag": "17bc32b1-475a-4b13-b961-57b63a7f446f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:59.385864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5cdbbd15-8874-431b-84b0-62139801f20f req-e840b8c1-8496-4e55-99cf-260d688b2e59 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.386640 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5cdbbd15-8874-431b-84b0-62139801f20f req-e840b8c1-8496-4e55-99cf-260d688b2e59 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.386897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5cdbbd15-8874-431b-84b0-62139801f20f req-e840b8c1-8496-4e55-99cf-260d688b2e59 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.400188 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-5cdbbd15-8874-431b-84b0-62139801f20f req-e840b8c1-8496-4e55-99cf-260d688b2e59 service nova] Creating event network-changed:17bc32b1-475a-4b13-b961-57b63a7f446f for instance cdda6e45-0167-46da-96c8-2d23ee9767db on hv-cinder-85426 Aug 29 21:39:59.405796 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-5cdbbd15-8874-431b-84b0-62139801f20f req-e840b8c1-8496-4e55-99cf-260d688b2e59 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035819 Aug 29 21:39:59.406714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 555/1070] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:00.310827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:00.312215 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:00.324667 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.325613 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.326341 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.327494 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.328002 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.328617 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.549209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:00.558642 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-aaecdefc-0990-4de6-b7c9-7c196fcd4bb9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.254365 Aug 29 21:40:00.559362 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 516/1071] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:00 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:01.583006 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:01.583729 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:01.590817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:01.591297 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:01.591724 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:01.592451 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:01.592896 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:01.593314 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:01.742418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:01.750582 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-91fb0b0c-52d0-416d-bbad-a7e0ec9f6405 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.173050 Aug 29 21:40:01.751186 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 556/1072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:01 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:02.772176 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:02.772771 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:02.779323 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.779801 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.780266 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.780993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.781639 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.782052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.928098 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:02.936336 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1c2f8a59-0e7e-4939-8901-5ba715c63e40 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.168171 Aug 29 21:40:02.936944 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 517/1073] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:02 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:03.959558 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:03.960402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:03.963129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:03.968321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.968807 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.969261 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.969931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.970377 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.971047 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.168170 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:04.177445 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-703addc5-0f2a-4b88-a2ac-318247069db4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.222280 Aug 29 21:40:04.178028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 557/1074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:03 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:05.202729 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:05.203466 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:05.212426 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.212933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.213355 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.214065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.214520 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.215665 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.358273 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:05.366239 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9001bdb6-4a9c-4cb0-9aee-43d3a38dc2ef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.167426 Aug 29 21:40:05.366818 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 518/1075] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:05 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:06.388705 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:06.389338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:06.391837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=8 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:06.397458 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:06.407335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:06.407335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.407335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:06.407335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:06.407823 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.555119 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:06.563659 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-687a53a3-f41a-45fe-9fb2-adeb55fa1fcb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.178840 Aug 29 21:40:06.564290 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 558/1076] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:06 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:07.587763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:07.588569 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:07.590838 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:07.596347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.597742 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.597892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:07.598487 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.598944 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.599460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:07.767469 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:07.776572 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-984086a0-9892-4dea-9def-f518e80314f8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.194717 Aug 29 21:40:07.777175 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 519/1077] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:07 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:08.798372 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:08.799141 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:08.807450 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:08.807970 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:08.808409 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:08.809131 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:08.809584 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:08.810010 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:08.967552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:08.978522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-31112353-0ad2-4865-bab2-41bab021a9f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.184107 Aug 29 21:40:08.979117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 559/1078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:08 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:09.998957 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:09.999575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:10.006626 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.011479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.011479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.011479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.011479 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.011954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.165855 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-8f84d3e9-d1d7-4313-b17b-675489e0ff20 req-e965db61-b30c-40c7-9d4a-a858803969ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdda6e45-0167-46da-96c8-2d23ee9767db", "name": "network-vif-plugged", "status": "completed", "tag": "17bc32b1-475a-4b13-b961-57b63a7f446f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:10.178065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:10.183159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-8f84d3e9-d1d7-4313-b17b-675489e0ff20 req-e965db61-b30c-40c7-9d4a-a858803969ea service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.183159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-8f84d3e9-d1d7-4313-b17b-675489e0ff20 req-e965db61-b30c-40c7-9d4a-a858803969ea service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.183159 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-8f84d3e9-d1d7-4313-b17b-675489e0ff20 req-e965db61-b30c-40c7-9d4a-a858803969ea service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.191709 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-17f5a423-cfc8-4a56-8747-a8d8eeb15859 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.196073 Aug 29 21:40:10.192499 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 520/1079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:09 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:10.192719 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-8f84d3e9-d1d7-4313-b17b-675489e0ff20 req-e965db61-b30c-40c7-9d4a-a858803969ea service nova] Creating event network-vif-plugged:17bc32b1-475a-4b13-b961-57b63a7f446f for instance cdda6e45-0167-46da-96c8-2d23ee9767db on hv-cinder-85426 Aug 29 21:40:10.198382 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-8f84d3e9-d1d7-4313-b17b-675489e0ff20 req-e965db61-b30c-40c7-9d4a-a858803969ea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036288 Aug 29 21:40:10.199331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 560/1080] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:11.217510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:11.218146 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:11.225827 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.226307 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.226738 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.227432 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.227880 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.228319 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.373948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:11.385972 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-e9dacbe8-5551-441b-b23e-a32e8fb66a09 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1266 microversion: 2.1 time: 0.172101 Aug 29 21:40:11.386459 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 521/1081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:11 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:12.409450 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:12.410083 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:12.416838 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.417323 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.417805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.418535 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.418990 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.419417 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.573754 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:12.582510 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b6e36a64-1d3f-4ce2-9ab4-2f816ef1cb5c tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1453 microversion: 2.1 time: 0.178019 Aug 29 21:40:12.583097 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 561/1082] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:12 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:12.604224 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:12.605003 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:12.611802 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.612347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.613719 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.614135 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.614690 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.615127 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.763954 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:12.771961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3d906f84-c5d8-40ae-8319-7218585a8b0d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1453 microversion: 2.1 time: 0.171792 Aug 29 21:40:12.772578 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 522/1083] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:12 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:15.150373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-b7907b93-47d4-49ca-985e-14b55e859423 req-4328e93f-a17d-496e-9319-6263920b5d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdda6e45-0167-46da-96c8-2d23ee9767db", "tag": "17bc32b1-475a-4b13-b961-57b63a7f446f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:15.162279 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-b7907b93-47d4-49ca-985e-14b55e859423 req-4328e93f-a17d-496e-9319-6263920b5d8d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:15.162762 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-b7907b93-47d4-49ca-985e-14b55e859423 req-4328e93f-a17d-496e-9319-6263920b5d8d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:15.163219 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-b7907b93-47d4-49ca-985e-14b55e859423 req-4328e93f-a17d-496e-9319-6263920b5d8d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:15.176689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-b7907b93-47d4-49ca-985e-14b55e859423 req-4328e93f-a17d-496e-9319-6263920b5d8d service nova] Creating event network-changed:17bc32b1-475a-4b13-b961-57b63a7f446f for instance cdda6e45-0167-46da-96c8-2d23ee9767db on hv-cinder-85426 Aug 29 21:40:15.183236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-b7907b93-47d4-49ca-985e-14b55e859423 req-4328e93f-a17d-496e-9319-6263920b5d8d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035968 Aug 29 21:40:15.183236 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 562/1084] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:38.490455 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:38.491126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:38.491126 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:38.492078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=44 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:38.493691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=22 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:38.494382 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=54 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:38.496692 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-ae4d0e17-83f6-431b-ac4c-43eb9dbba264 req-179021a9-e902-407d-87a8-55061ab2ce13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be1edde-e1cc-4d22-a11b-a050e511161e", "tag": "a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:38.503543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.503543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.503543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.503543 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.503976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.503976 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.507554 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ae4d0e17-83f6-431b-ac4c-43eb9dbba264 req-179021a9-e902-407d-87a8-55061ab2ce13 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.508374 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ae4d0e17-83f6-431b-ac4c-43eb9dbba264 req-179021a9-e902-407d-87a8-55061ab2ce13 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.508997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-ae4d0e17-83f6-431b-ac4c-43eb9dbba264 req-179021a9-e902-407d-87a8-55061ab2ce13 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.522805 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-ae4d0e17-83f6-431b-ac4c-43eb9dbba264 req-179021a9-e902-407d-87a8-55061ab2ce13 service nova] Creating event network-changed:a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305 for instance 0be1edde-e1cc-4d22-a11b-a050e511161e on hv-cinder-85426 Aug 29 21:40:38.531104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-ae4d0e17-83f6-431b-ac4c-43eb9dbba264 req-179021a9-e902-407d-87a8-55061ab2ce13 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042081 Aug 29 21:40:38.532181 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 563/1085] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:38.534812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:40:38.898869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-617f4ec8-f1ee-4560-85c4-448718d127c2 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 204 len: 0 microversion: 2.1 time: 0.412834 Aug 29 21:40:38.902933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 523/1086] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:38 2022] DELETE /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:38.910338 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:38.911248 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:38.919652 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.920569 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.921277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.922082 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.922613 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.923117 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.086327 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:39.096898 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-06e992d1-ca20-4480-8b82-19777a39fd34 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.191676 Aug 29 21:40:39.098641 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 564/1087] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:38 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:40.121023 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:40.121786 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:40.129463 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.129942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.130367 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.131076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.131521 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.132051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.292404 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:40.301076 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a0218543-b8b2-4bbc-8afb-d4f06ddf6fdc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1565 microversion: 2.1 time: 0.184295 Aug 29 21:40:40.301649 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 524/1088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:40 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:41.256984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-251b4695-9668-494e-94d4-4425c8703c91 req-60af7b7e-09dc-4e63-90d1-60759311ca55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be1edde-e1cc-4d22-a11b-a050e511161e", "name": "network-vif-deleted", "tag": "a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:41.266449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-251b4695-9668-494e-94d4-4425c8703c91 req-60af7b7e-09dc-4e63-90d1-60759311ca55 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:41.268995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-251b4695-9668-494e-94d4-4425c8703c91 req-60af7b7e-09dc-4e63-90d1-60759311ca55 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:41.268995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-251b4695-9668-494e-94d4-4425c8703c91 req-60af7b7e-09dc-4e63-90d1-60759311ca55 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:41.279049 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-251b4695-9668-494e-94d4-4425c8703c91 req-60af7b7e-09dc-4e63-90d1-60759311ca55 service nova] Creating event network-vif-deleted:a838bbd4-cf8f-47bd-a7c2-b6cfdb54e305 for instance 0be1edde-e1cc-4d22-a11b-a050e511161e on hv-cinder-85426 Aug 29 21:40:41.284394 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-251b4695-9668-494e-94d4-4425c8703c91 req-60af7b7e-09dc-4e63-90d1-60759311ca55 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031219 Aug 29 21:40:41.284981 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 565/1089] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:41.321870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:41.322486 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:41.328930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:41.329415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:41.329851 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:41.330677 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:41.331109 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:41.331581 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:41.395731 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:41.403803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-18c33484-eb98-401a-ac7b-3aa5711bf758 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1380 microversion: 2.1 time: 0.085706 Aug 29 21:40:41.406357 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 525/1090] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:41 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:42.426174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:42.426864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:42.433509 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.433995 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.434522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.435230 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.435704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.436182 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.469109 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.469585 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.470021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.470537 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.objects.instance [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lazy-loading 'fault' on Instance uuid 0be1edde-e1cc-4d22-a11b-a050e511161e {{(pid=121558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:42.515129 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6576ed5b370049f5bd091512d9803d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd13ced46854940b3765ee641390212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:42.523353 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7d2d5960-394d-49f4-b02c-a825f79004fc tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 200 len: 1223 microversion: 2.1 time: 0.102206 Aug 29 21:40:42.524157 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 566/1091] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:42 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:43.660231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:43.661179 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] [instance: 0be1edde-e1cc-4d22-a11b-a050e511161e] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:43.667396 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.667922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.668360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.669058 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.669525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.669938 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.685993 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] HTTP exception thrown: Instance 0be1edde-e1cc-4d22-a11b-a050e511161e could not be found. Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Request method failure captured: Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e HTTP/1.1 Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTEnjc4BYolq7EQHSHPAdXvp5LYkY5bnfU3qLp_s6QrOmeDyHCCw3F-gnvG2HsdGtcf8E9UICFGmTUVkojFPEzKfCjPYEz7z0F9St_u2FfNKb-OT-1XfXr_pqjDKVzIhs_Sz_47VN1dikcApEJ6uRUrsFxg9vemNCaM_YYpSJDnP07M Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: ecd13ced46854940b3765ee641390212 Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-TestShelveInstance-866323581 Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:40:43.687637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ecd13ced46854940b3765ee641390212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ecd13ced46854940b3765ee641390212", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ecd13ced46854940b3765ee641390212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ecd13ced46854940b3765ee641390212"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-TestShelveInstance-866323581 Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: ecd13ced46854940b3765ee641390212 Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-TestShelveInstance-866323581 Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-TestShelveInstance-866323581-project Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 6576ed5b370049f5bd091512d9803d3c Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-TestShelveInstance-866323581-project Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 0be1edde-e1cc-4d22-a11b-a050e511161e could not be found. Aug 29 21:40:43.689795 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '0be1edde-e1cc-4d22-a11b-a050e511161e'} Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be1edde-e1cc-4d22-a11b-a050e511161e could not be found. Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:43.690826 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be1edde-e1cc-4d22-a11b-a050e511161e could not be found. Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be1edde-e1cc-4d22-a11b-a050e511161e could not be found. Aug 29 21:40:43.692546 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:40:43.694090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Returning 404 to user: Instance 0be1edde-e1cc-4d22-a11b-a050e511161e could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:43.694090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c740e85f-4d9b-4470-9637-9f43da986c9d tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e" status: 404 len: 111 microversion: 2.1 time: 0.146912 Aug 29 21:40:43.694090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 526/1092] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:43 2022] GET /compute/v2.1/servers/0be1edde-e1cc-4d22-a11b-a050e511161e => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:43.948940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b83cf1d0-d97e-4bb9-902d-1c042d09f639 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] Calling method '.version_select at 0x7fc840308ca0>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:44.040518 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b83cf1d0-d97e-4bb9-902d-1c042d09f639 tempest-TestShelveInstance-866323581 tempest-TestShelveInstance-866323581-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-647035061" status: 202 len: 0 microversion: 2.1 time: 0.097183 Aug 29 21:40:44.041142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 567/1093] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Aug 29 21:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-647035061 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:42:12.708043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:12.708849 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:12.709753 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 21:42:12.709907 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Mon Aug 29 21:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db (ip 10.222.0.65) !!! Aug 29 21:42:12.711107 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:42:12.711233 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Mon Aug 29 21:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db (ip 10.222.0.65) !!! Aug 29 21:42:12.715773 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:12.718666 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:12.725632 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.726182 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.726614 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.727309 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.727763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.728212 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.755514 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Going to try to terminate instance {{(pid=121559) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:42:13.079046 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-51821d2d-37e0-4038-9e54-9cb73090e89b tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 204 len: 0 microversion: 2.1 time: 0.372496 Aug 29 21:42:13.079637 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 527/1094] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:42:12 2022] DELETE /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:42:13.086993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=18 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:13.092508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:13.093492 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:13.094104 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:13.101110 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.101593 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.102028 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.102741 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.103191 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.103619 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.469716 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:13.478259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a98bcd9b-70f6-40ef-a744-51193b9e418f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1578 microversion: 2.1 time: 0.393877 Aug 29 21:42:13.480881 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 568/1095] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:13 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1578 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:14.503014 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:14.503726 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:14.510306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:14.510783 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:14.511212 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:14.511914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:14.512360 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:14.512778 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:14.772232 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:14.780152 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-6ad23b94-9b39-4c95-931a-b2d1828c09cb tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1578 microversion: 2.1 time: 0.281455 Aug 29 21:42:14.780723 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 528/1096] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:14 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1578 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:15.566552 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-456a64c5-bb29-4747-9c9f-b0e08f65f8f6 req-a4252c35-c16d-4752-bc60-c039aa619cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdda6e45-0167-46da-96c8-2d23ee9767db", "name": "network-vif-deleted", "tag": "17bc32b1-475a-4b13-b961-57b63a7f446f"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:15.576859 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-456a64c5-bb29-4747-9c9f-b0e08f65f8f6 req-a4252c35-c16d-4752-bc60-c039aa619cda service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:15.577342 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-456a64c5-bb29-4747-9c9f-b0e08f65f8f6 req-a4252c35-c16d-4752-bc60-c039aa619cda service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:15.577774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-456a64c5-bb29-4747-9c9f-b0e08f65f8f6 req-a4252c35-c16d-4752-bc60-c039aa619cda service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:15.589491 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-456a64c5-bb29-4747-9c9f-b0e08f65f8f6 req-a4252c35-c16d-4752-bc60-c039aa619cda service nova] Creating event network-vif-deleted:17bc32b1-475a-4b13-b961-57b63a7f446f for instance cdda6e45-0167-46da-96c8-2d23ee9767db on hv-cinder-85426 Aug 29 21:42:15.594638 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-456a64c5-bb29-4747-9c9f-b0e08f65f8f6 req-a4252c35-c16d-4752-bc60-c039aa619cda service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032702 Aug 29 21:42:15.595356 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 569/1097] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:15.801497 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:15.802100 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:15.808675 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:15.809153 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:15.809679 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:15.810373 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:15.810910 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:15.811332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:15.878712 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:15.886886 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1274b078-36ee-441f-9d51-8fb976f74666 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 200 len: 1225 microversion: 2.1 time: 0.089303 Aug 29 21:42:15.887458 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 529/1098] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:15 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:16.908565 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:16.909296 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:16.915538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:16.920423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:16.920423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:16.920423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:16.920423 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:16.920875 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:16.932187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] HTTP exception thrown: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Request method failure captured: Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db HTTP/1.1 Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTILcjEFChxOh_8Q6iITN3-2qpffHQOIVYODTQ6gMfLKw0aEhxXZ0IsiDoTOU922WJGLW1e4927Lot-56lWXRcQJ3cw8LA3mCUShvuobThp6X1AJmc0aQlwEnNlnV0n4_MrUSP2lIs1xmBpFbQkTCOnXTc2iwgQza94PFD5RJxrol4Q Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:42:16.933836 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_77472ffae4da491881e41c08aa09e4fc", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 0d57f52dc9044a259e6acbde81ac0476 Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:42:16.935674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'cdda6e45-0167-46da-96c8-2d23ee9767db'} Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:42:16.937504 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:42:16.939211 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:42:16.940804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Returning 404 to user: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:42:16.940804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-88d21fc9-4d45-4f49-9b0d-c9aa38c10d12 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 404 len: 111 microversion: 2.1 time: 0.031469 Aug 29 21:42:16.940804 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 570/1099] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:16 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:42:17.036953 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1440369416", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1734531656", "security_groups": [{"name": "tempest-secgroup-smoke-1944143218"}], "block_device_mapping_v2": [{"uuid": "5e661897-0b4e-45d2-a7eb-4ef1b01d74be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "526ac953-2d63-4bf1-8bf8-4e48840fae3d"}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:17.154672 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] validate_networks() for [('526ac953-2d63-4bf1-8bf8-4e48840fae3d', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:42:17.567451 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:42:17.567867 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:42:17.568372 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:42:17.568777 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:42:17.569185 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:42:17.578279 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:17.578752 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:17.579178 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:17.579915 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:17.580369 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:17.580787 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:17.597977 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for project 77472ffae4da491881e41c08aa09e4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:42:17.601884 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for user 0d57f52dc9044a259e6acbde81ac0476 and project 77472ffae4da491881e41c08aa09e4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:42:17.659347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:42:17.661461 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e661897-0b4e-45d2-a7eb-4ef1b01d74be',volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:42:18.065456 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c31ec534-4f79-41da-a0c7-c3da5112a64f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.032350 Aug 29 21:42:18.066183 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 530/1100] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:42:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:42:18.077171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-b70db712-67d0-4ca3-baca-d1153c1de778 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:18.080522 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-b70db712-67d0-4ca3-baca-d1153c1de778 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:18.137243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-b70db712-67d0-4ca3-baca-d1153c1de778 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:18.147783 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-b70db712-67d0-4ca3-baca-d1153c1de778 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1095 microversion: 2.1 time: 0.074587 Aug 29 21:42:18.148864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 571/1101] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:18 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:19.168052 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:19.168658 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:19.175736 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.176256 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.176695 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.177412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.177865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.178290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.250210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:19.258436 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-ead25189-3c6b-473f-ba97-b8030301776a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1145 microversion: 2.1 time: 0.094752 Aug 29 21:42:19.259016 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 531/1102] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:19 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:20.284649 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:20.285605 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:20.292935 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:20.293449 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:20.293886 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:20.294592 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:20.295043 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:20.295468 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:20.370905 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:20.379600 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0a5a6ae7-12bf-4ae3-85a1-f2b27b28f719 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1211 microversion: 2.1 time: 0.099667 Aug 29 21:42:20.380300 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 572/1103] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:20 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:21.401175 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:21.401847 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:21.409220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:21.409768 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:21.410214 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:21.410928 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:21.411434 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:21.411876 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:21.621260 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:21.632678 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-c5054bcb-9dd9-45cd-b9d8-66baf1f5aba9 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1279 microversion: 2.1 time: 0.235301 Aug 29 21:42:21.633529 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 532/1104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:21 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:22.322426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-9b67bbc6-12ea-49c6-8ffd-af88a03545a8 req-c2362908-4f77-4b1a-9e61-833e236299b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6eb865-157c-4fbe-ba0d-515436f70ee5", "tag": "93df90ce-afcc-473a-9691-e95cf9df4eba"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:22.333464 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9b67bbc6-12ea-49c6-8ffd-af88a03545a8 req-c2362908-4f77-4b1a-9e61-833e236299b8 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:22.334037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9b67bbc6-12ea-49c6-8ffd-af88a03545a8 req-c2362908-4f77-4b1a-9e61-833e236299b8 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:22.334474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-9b67bbc6-12ea-49c6-8ffd-af88a03545a8 req-c2362908-4f77-4b1a-9e61-833e236299b8 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:22.349274 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-9b67bbc6-12ea-49c6-8ffd-af88a03545a8 req-c2362908-4f77-4b1a-9e61-833e236299b8 service nova] Creating event network-changed:93df90ce-afcc-473a-9691-e95cf9df4eba for instance db6eb865-157c-4fbe-ba0d-515436f70ee5 on hv-cinder-85426 Aug 29 21:42:22.355136 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-9b67bbc6-12ea-49c6-8ffd-af88a03545a8 req-c2362908-4f77-4b1a-9e61-833e236299b8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036297 Aug 29 21:42:22.355980 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 573/1105] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:22.653648 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:22.654645 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:22.661603 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:22.662090 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:22.662525 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:22.663229 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:22.663687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:22.664148 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:22.890749 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:22.899165 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-5bd987e3-db88-4820-84d1-7deae1c0361f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.249262 Aug 29 21:42:22.899752 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 533/1106] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:22 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:23.922795 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:23.923487 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:23.929813 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:23.930293 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:23.930723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:23.931430 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:23.931868 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:23.935405 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:24.073914 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:24.081648 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0f7f6073-4a47-445b-a202-87c6b57d7c94 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.164353 Aug 29 21:42:24.082942 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 574/1107] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:23 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:25.104586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:25.104586 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:25.112296 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:25.112788 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:25.113230 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:25.113922 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:25.114457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:25.114800 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:25.263711 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:25.272282 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-14efaff7-e636-485e-a834-3cea8c21321d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.172404 Aug 29 21:42:25.272886 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 534/1108] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:25 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:26.292084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:26.292675 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:26.299152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:26.299717 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:26.300142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:26.300785 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:26.301229 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:26.301647 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:26.436212 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:26.444940 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-71645cef-6b8a-4ff3-9f72-53fc9ff3c17d tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.156872 Aug 29 21:42:26.445513 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 575/1109] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:26 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:27.466917 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:27.467630 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:27.475563 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:27.476093 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:27.476553 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:27.477306 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:27.477785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:27.478232 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:27.588806 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:27.608480 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=6 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:27.612913 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:27.620940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2d5194e4-5147-4fd6-ab37-07ee669f8960 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.158943 Aug 29 21:42:27.621508 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 535/1110] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:27 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:28.642549 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:28.643214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:28.645570 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=2 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:28.650253 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:28.660984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:28.660984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:28.660984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:28.660984 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:28.661421 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:28.788873 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:28.796713 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-63d55323-de84-4698-b4b4-c88eba332298 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.157995 Aug 29 21:42:28.797316 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 576/1111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:28 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:29.818651 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:29.819262 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:29.826343 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:29.826818 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:29.827251 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:29.827981 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:29.829162 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:29.829590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:29.973779 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:29.981337 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-176c085a-6bfc-4069-8d00-d8d23b4fb87a tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.166685 Aug 29 21:42:29.981900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 536/1112] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:29 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:31.002856 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:31.003469 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:31.010239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:31.010776 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:31.011214 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:31.012005 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:31.012465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:31.012890 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:31.163207 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:31.171047 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-e50a2344-f99b-4c31-9c2e-64058e8bcc71 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.172833 Aug 29 21:42:31.171772 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 577/1113] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:30 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:32.192590 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:32.193635 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:32.199329 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:32.199816 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:32.200290 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:32.201022 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:32.201481 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:32.201910 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:32.334843 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:32.342593 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f9b6f22e-a701-4e8a-8109-3d19b380b847 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.154861 Aug 29 21:42:32.343170 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 537/1114] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:32 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:32.992331 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-5d65314c-8dae-47c5-9006-0e07f4bd8e58 req-d779d781-85d0-4f47-8bd7-b4a0985fa038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6eb865-157c-4fbe-ba0d-515436f70ee5", "name": "network-vif-plugged", "status": "completed", "tag": "93df90ce-afcc-473a-9691-e95cf9df4eba"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:33.003245 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5d65314c-8dae-47c5-9006-0e07f4bd8e58 req-d779d781-85d0-4f47-8bd7-b4a0985fa038 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:33.005977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5d65314c-8dae-47c5-9006-0e07f4bd8e58 req-d779d781-85d0-4f47-8bd7-b4a0985fa038 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:33.005977 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-5d65314c-8dae-47c5-9006-0e07f4bd8e58 req-d779d781-85d0-4f47-8bd7-b4a0985fa038 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:33.018187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-5d65314c-8dae-47c5-9006-0e07f4bd8e58 req-d779d781-85d0-4f47-8bd7-b4a0985fa038 service nova] Creating event network-vif-plugged:93df90ce-afcc-473a-9691-e95cf9df4eba for instance db6eb865-157c-4fbe-ba0d-515436f70ee5 on hv-cinder-85426 Aug 29 21:42:33.023122 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-5d65314c-8dae-47c5-9006-0e07f4bd8e58 req-d779d781-85d0-4f47-8bd7-b4a0985fa038 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034681 Aug 29 21:42:33.023772 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 578/1115] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:33.363917 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:33.364510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:33.371063 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:33.375785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:33.375785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:33.375785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:33.375785 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:33.376238 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:33.508388 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:33.516119 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-dffeb066-a1fe-4f65-bbf4-edb023dd14de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1267 microversion: 2.1 time: 0.156560 Aug 29 21:42:33.516684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 538/1116] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:33 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:34.538237 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:34.539689 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:34.546493 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:34.547649 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:34.548121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:34.548816 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:34.549273 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:34.549696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:34.686432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:34.694347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-a3287b12-a23d-433f-b519-641855bb99de tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1453 microversion: 2.1 time: 0.160964 Aug 29 21:42:34.694926 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 579/1117] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:34 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:34.714595 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:34.715209 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:34.722727 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:34.723212 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:34.723906 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:34.724618 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:34.725071 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:34.725496 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:34.875390 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:34.884620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-eb95c472-010f-474a-a386-2cf370779eac tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1453 microversion: 2.1 time: 0.173800 Aug 29 21:42:34.885205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 539/1118] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:34 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:36.871512 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-afb097f8-1e7c-40df-ab2b-582e579761f5 req-7a4f7573-4f1d-4291-b605-5c189f166caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6eb865-157c-4fbe-ba0d-515436f70ee5", "tag": "93df90ce-afcc-473a-9691-e95cf9df4eba"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:36.883152 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-afb097f8-1e7c-40df-ab2b-582e579761f5 req-7a4f7573-4f1d-4291-b605-5c189f166caf service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:36.883714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-afb097f8-1e7c-40df-ab2b-582e579761f5 req-7a4f7573-4f1d-4291-b605-5c189f166caf service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:36.886676 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-afb097f8-1e7c-40df-ab2b-582e579761f5 req-7a4f7573-4f1d-4291-b605-5c189f166caf service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:36.896696 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-afb097f8-1e7c-40df-ab2b-582e579761f5 req-7a4f7573-4f1d-4291-b605-5c189f166caf service nova] Creating event network-changed:93df90ce-afcc-473a-9691-e95cf9df4eba for instance db6eb865-157c-4fbe-ba0d-515436f70ee5 on hv-cinder-85426 Aug 29 21:42:36.901759 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-afb097f8-1e7c-40df-ab2b-582e579761f5 req-7a4f7573-4f1d-4291-b605-5c189f166caf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033965 Aug 29 21:42:36.902388 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 580/1119] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:12.806059 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:12.806799 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:12.812103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-321673617", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1734531656", "security_groups": [{"name": "tempest-secgroup-smoke-1944143218"}], "block_device_mapping_v2": [{"uuid": "db326df5-f896-4b1f-9f01-0773ec990781", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "526ac953-2d63-4bf1-8bf8-4e48840fae3d"}]}} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:12.935800 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.network.neutron [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] validate_networks() for [('526ac953-2d63-4bf1-8bf8-4e48840fae3d', None, None, None, None, None)] {{(pid=121559) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:44:13.315863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Flavor limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:44:13.316300 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Image limits 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:44:13.316763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Flavor pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:44:13.317163 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Image pref 0:0:0 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:44:13.317566 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.virt.hardware [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:44:13.326792 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:13.327261 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:13.327691 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:13.328438 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:13.328886 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:13.329301 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:13.347540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for project 77472ffae4da491881e41c08aa09e4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:44:13.351605 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.quota [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Getting quotas for user 0d57f52dc9044a259e6acbde81ac0476 and project 77472ffae4da491881e41c08aa09e4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=121559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:44:13.409703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Going to run 1 instances... {{(pid=121559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:44:13.411871 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db326df5-f896-4b1f-9f01-0773ec990781',volume_size=None,volume_type=None)] {{(pid=121559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:44:13.802393 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-9ff558c7-a7a0-42ac-b0dc-f6dad82bc292 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.998033 Aug 29 21:44:13.803042 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 540/1120] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Aug 29 21:44:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:44:13.812999 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=28 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:13.814524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=52 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:13.814975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:44:13.815123 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Mon Aug 29 21:44:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 (ip 10.222.0.65) !!! Aug 29 21:44:13.816374 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:44:13.816608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Mon Aug 29 21:44:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 (ip 10.222.0.65) !!! Aug 29 21:44:13.825357 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ba1c5604-a80b-420a-bf50-01ff1968eae6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:13.826277 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ba1c5604-a80b-420a-bf50-01ff1968eae6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:13.884457 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ba1c5604-a80b-420a-bf50-01ff1968eae6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:13.892426 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ba1c5604-a80b-420a-bf50-01ff1968eae6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1094 microversion: 2.1 time: 0.081739 Aug 29 21:44:13.892989 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 581/1121] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:13 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:14.912540 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-a676e026-d406-4ee7-9f04-de7044c33b44 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:14.913142 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-a676e026-d406-4ee7-9f04-de7044c33b44 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:14.967927 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-a676e026-d406-4ee7-9f04-de7044c33b44 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:14.975670 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-a676e026-d406-4ee7-9f04-de7044c33b44 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1094 microversion: 2.1 time: 0.066965 Aug 29 21:44:14.976253 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 541/1122] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:14 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:15.997837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-ce7f1c2b-33c6-4ddf-ae01-00be81802635 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:15.998432 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-ce7f1c2b-33c6-4ddf-ae01-00be81802635 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:16.051832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-ce7f1c2b-33c6-4ddf-ae01-00be81802635 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:16.058733 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-ce7f1c2b-33c6-4ddf-ae01-00be81802635 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1094 microversion: 2.1 time: 0.065038 Aug 29 21:44:16.059373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 582/1123] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:15 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:17.082212 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-b90ffd4e-0f50-42b9-a1b3-87b019052bef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:17.082812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-b90ffd4e-0f50-42b9-a1b3-87b019052bef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:17.143551 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-b90ffd4e-0f50-42b9-a1b3-87b019052bef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:17.150675 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-b90ffd4e-0f50-42b9-a1b3-87b019052bef tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1094 microversion: 2.1 time: 0.072361 Aug 29 21:44:17.151231 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 542/1124] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:17 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:18.172418 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:18.173233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:18.181340 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:18.181975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:18.182390 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:18.183080 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:18.183532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:18.184207 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:18.246171 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:18.254064 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0578ad26-e3a5-48d8-87f5-029decb78667 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1144 microversion: 2.1 time: 0.086472 Aug 29 21:44:18.254629 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 583/1125] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:18 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:19.274632 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:19.275399 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:19.283103 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:19.283582 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:19.284051 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:19.284740 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:19.285193 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:19.285612 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:19.349854 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:19.356835 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-4473b090-8259-4370-bcb0-5c348030dbc3 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1192 microversion: 2.1 time: 0.086125 Aug 29 21:44:19.357507 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 543/1126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:19 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:20.378222 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:20.378843 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:20.385789 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:20.386270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:20.386704 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:20.387399 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:20.387837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:20.388284 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:20.456243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:20.464347 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-50fb4aa7-67af-4d33-be6c-658b0eaaa158 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1210 microversion: 2.1 time: 0.089857 Aug 29 21:44:20.464931 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 584/1127] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:20 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:21.485599 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:21.486216 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:21.492722 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:21.493236 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:21.493676 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:21.494381 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:21.494837 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:21.495284 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:21.647036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:21.655061 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-858c1b71-6f0b-41bb-aeed-20b73d9059c1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.173311 Aug 29 21:44:21.655629 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 544/1128] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:21 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:21.760305 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [req-c51fb168-f37b-4a6d-958c-ff97d99ed35b req-98f02e8a-0291-4f99-b212-144c2f64531d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262cc35f-b67e-4036-912a-7b0bd1a890a9", "tag": "61a6f040-769a-4c6e-a924-16e8826a4df8"}]} {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:21.769945 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c51fb168-f37b-4a6d-958c-ff97d99ed35b req-98f02e8a-0291-4f99-b212-144c2f64531d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:21.773714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c51fb168-f37b-4a6d-958c-ff97d99ed35b req-98f02e8a-0291-4f99-b212-144c2f64531d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:21.773714 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [req-c51fb168-f37b-4a6d-958c-ff97d99ed35b req-98f02e8a-0291-4f99-b212-144c2f64531d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:21.782329 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.compute.server_external_events [req-c51fb168-f37b-4a6d-958c-ff97d99ed35b req-98f02e8a-0291-4f99-b212-144c2f64531d service nova] Creating event network-changed:61a6f040-769a-4c6e-a924-16e8826a4df8 for instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 on hv-cinder-85426 Aug 29 21:44:21.787233 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [req-c51fb168-f37b-4a6d-958c-ff97d99ed35b req-98f02e8a-0291-4f99-b212-144c2f64531d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093240 Aug 29 21:44:21.787842 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 585/1129] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:44:22.675427 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:22.676065 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:22.682553 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:22.683035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:22.683474 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:22.684198 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:22.684652 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:22.685071 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:22.820401 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:22.828601 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-8f52ec8f-3bd1-40f8-993b-85d66ab0b208 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.157088 Aug 29 21:44:22.829205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 545/1130] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:22 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:23.852742 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:23.855243 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:23.860345 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:23.860828 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:23.861259 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:23.861956 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:23.862405 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:23.862851 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:23.992308 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:24.000146 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-369841be-edb7-419f-ba67-59be112c83d6 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.152485 Aug 29 21:44:24.000723 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 586/1131] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:23 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:25.020948 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:25.021589 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:25.023412 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=2 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:25.028838 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:25.029803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:25.029803 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:25.030425 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:25.030872 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:25.031285 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:25.164892 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:25.173477 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3312bb7b-9496-4512-99a6-a232a8f790f1 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.156255 Aug 29 21:44:25.174050 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 546/1132] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:25 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:26.194182 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:26.194834 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:26.197206 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell0:SELECT=4 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:26.203292 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:26.203772 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:26.204231 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:26.204920 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:26.205373 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:26.205793 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:26.337730 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:26.346679 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-1364a495-682d-43fa-bcd2-8e11c0334336 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.156281 Aug 29 21:44:26.347267 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 587/1133] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:26 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:27.367942 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:27.368556 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:27.370863 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell0:SELECT=10 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:27.376220 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:27.376702 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:27.377137 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:27.377940 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:27.378393 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:27.378814 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:27.517871 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:27.525625 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-bc71fdd1-208e-44f1-9eb5-c8890b1a0cc8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.161622 Aug 29 21:44:27.526185 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 547/1134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:27 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:28.546106 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:28.547437 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:28.552993 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:28.553474 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:28.553904 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:28.554590 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:28.555039 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:28.555469 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:28.688304 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:28.696026 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-bf2c2c94-fde1-4b74-a7ed-698938233eb4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.153892 Aug 29 21:44:28.696608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 588/1135] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:28 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:29.717363 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:29.717946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:29.724415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:29.724902 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:29.725334 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:29.726024 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:29.726538 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:29.726900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:29.855996 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:29.863703 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-3e60d287-19c6-4f2e-8fdd-83efa0c0ed51 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.150733 Aug 29 21:44:29.864295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 548/1136] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:29 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:30.884073 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:30.884686 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:30.891192 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:30.891608 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:30.892095 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:30.892817 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:30.893270 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:30.893695 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:31.028599 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:31.036361 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-821290c0-1502-47ef-8e3d-125befa8cde0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.156136 Aug 29 21:44:31.036930 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 589/1137] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:30 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:32.057978 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:32.059036 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:32.066295 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:32.066775 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:32.067205 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:32.067935 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:32.068401 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:32.068822 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:32.258484 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:32.266478 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-78126410-7420-4a8e-a67c-20079cf56c01 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.212595 Aug 29 21:44:32.267140 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 549/1138] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:32 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:33.286674 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:33.287280 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:33.293650 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:33.294126 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:33.294560 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:33.295253 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:33.295703 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:33.296260 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:33.431902 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:33.440344 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-20a52804-a424-45a0-8954-4b78225d19f5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.157522 Aug 29 21:44:33.440925 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 590/1139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:33 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:33.614574 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-a1bed98e-8a8c-422e-b0d8-825d300e766a req-10a52f9b-abb0-4745-9d7c-0ba57a7bcb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262cc35f-b67e-4036-912a-7b0bd1a890a9", "name": "network-vif-plugged", "status": "completed", "tag": "61a6f040-769a-4c6e-a924-16e8826a4df8"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:33.624557 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-a1bed98e-8a8c-422e-b0d8-825d300e766a req-10a52f9b-abb0-4745-9d7c-0ba57a7bcb6d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:33.630503 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-a1bed98e-8a8c-422e-b0d8-825d300e766a req-10a52f9b-abb0-4745-9d7c-0ba57a7bcb6d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:33.630503 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-a1bed98e-8a8c-422e-b0d8-825d300e766a req-10a52f9b-abb0-4745-9d7c-0ba57a7bcb6d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:33.636559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-a1bed98e-8a8c-422e-b0d8-825d300e766a req-10a52f9b-abb0-4745-9d7c-0ba57a7bcb6d service nova] Creating event network-vif-plugged:61a6f040-769a-4c6e-a924-16e8826a4df8 for instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 on hv-cinder-85426 Aug 29 21:44:33.641647 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-a1bed98e-8a8c-422e-b0d8-825d300e766a req-10a52f9b-abb0-4745-9d7c-0ba57a7bcb6d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089514 Aug 29 21:44:33.642401 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 550/1140] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:34.461797 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:34.462389 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:34.469045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:34.469532 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:34.469975 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:34.470701 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:34.471158 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:34.471584 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:34.604240 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:34.612385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-01246fc0-d229-4209-a571-2b5514d95055 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1266 microversion: 2.1 time: 0.154482 Aug 29 21:44:34.612953 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 591/1141] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:34 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:35.634792 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:35.635510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:35.642961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:35.643510 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:35.643865 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:35.644583 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:35.645031 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:35.645448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:35.779196 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:35.787332 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-f6bd165a-582c-41a1-9f47-f921051a3adc tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1453 microversion: 2.1 time: 0.157289 Aug 29 21:44:35.787930 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 551/1142] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:35 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:35.806938 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:35.807542 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:35.814402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:35.814883 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:35.815321 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:35.816033 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:35.816486 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:35.816908 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:35.947524 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:35.957355 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-c1c093ad-d2a2-4a0d-9003-8831d4c70a7f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1453 microversion: 2.1 time: 0.154275 Aug 29 21:44:35.957926 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 592/1143] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:35 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:38.120155 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-315da414-00a4-42cb-ad46-c5addcdebe65 req-9bb7f542-8e1b-403c-994f-328c794a8759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262cc35f-b67e-4036-912a-7b0bd1a890a9", "tag": "61a6f040-769a-4c6e-a924-16e8826a4df8"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:38.129971 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-315da414-00a4-42cb-ad46-c5addcdebe65 req-9bb7f542-8e1b-403c-994f-328c794a8759 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:38.130454 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-315da414-00a4-42cb-ad46-c5addcdebe65 req-9bb7f542-8e1b-403c-994f-328c794a8759 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:38.130887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-315da414-00a4-42cb-ad46-c5addcdebe65 req-9bb7f542-8e1b-403c-994f-328c794a8759 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:38.142098 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-315da414-00a4-42cb-ad46-c5addcdebe65 req-9bb7f542-8e1b-403c-994f-328c794a8759 service nova] Creating event network-changed:61a6f040-769a-4c6e-a924-16e8826a4df8 for instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 on hv-cinder-85426 Aug 29 21:44:38.147077 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-315da414-00a4-42cb-ad46-c5addcdebe65 req-9bb7f542-8e1b-403c-994f-328c794a8759 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087479 Aug 29 21:44:38.151340 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 552/1144] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:46:10.017535 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:10.018345 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG dbcounter [-] [121559] Writing DB stats nova_cell1:SELECT=54 {{(pid=121559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:10.018837 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_api:SELECT=28 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:10.019794 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:46:10.020078 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG dbcounter [-] [121558] Writing DB stats nova_cell1:SELECT=56 {{(pid=121558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:10.020195 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Mon Aug 29 21:46:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Aug 29 21:46:10.026230 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-762961be-50ab-43b7-8646-2aea0a0b39e7 req-7e9a7574-201a-45ac-a70e-6a1f1c6da068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262cc35f-b67e-4036-912a-7b0bd1a890a9", "tag": "61a6f040-769a-4c6e-a924-16e8826a4df8"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:46:10.027508 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:10.027653 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:10.036385 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:10.036967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:10.037623 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:10.038812 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:10.039774 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:10.040187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:10.042520 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-762961be-50ab-43b7-8646-2aea0a0b39e7 req-7e9a7574-201a-45ac-a70e-6a1f1c6da068 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:10.043448 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-762961be-50ab-43b7-8646-2aea0a0b39e7 req-7e9a7574-201a-45ac-a70e-6a1f1c6da068 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:10.044025 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-762961be-50ab-43b7-8646-2aea0a0b39e7 req-7e9a7574-201a-45ac-a70e-6a1f1c6da068 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:10.060633 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-762961be-50ab-43b7-8646-2aea0a0b39e7 req-7e9a7574-201a-45ac-a70e-6a1f1c6da068 service nova] Creating event network-changed:61a6f040-769a-4c6e-a924-16e8826a4df8 for instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 on hv-cinder-85426 Aug 29 21:46:10.067620 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-762961be-50ab-43b7-8646-2aea0a0b39e7 req-7e9a7574-201a-45ac-a70e-6a1f1c6da068 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051960 Aug 29 21:46:10.068421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 553/1145] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:46:10.083055 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:46:10.451031 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7c597001-f190-49d7-a1ec-fd130a9803b4 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "DELETE /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 204 len: 0 microversion: 2.1 time: 0.438896 Aug 29 21:46:10.452085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 593/1146] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:46:10 2022] DELETE /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:46:10.464307 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:10.465252 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:10.475687 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:10.476460 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:10.477193 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:10.478181 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:10.478870 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:10.479528 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:10.646706 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:10.659982 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-1715c81d-20fa-4b18-8d8d-5d44fc1db129 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1578 microversion: 2.1 time: 0.202755 Aug 29 21:46:10.660560 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 554/1147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:10 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:46:11.682749 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:11.683448 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:11.690239 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:11.690938 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:11.691194 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:11.691912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:11.692370 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:11.692794 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:11.836997 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:11.845603 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d748934f-4d11-4f62-8885-ddb54ebafd60 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1459 microversion: 2.1 time: 0.167138 Aug 29 21:46:11.846167 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 594/1148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:11 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:46:12.534515 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-9053f50c-00bb-42d1-9e9a-0b2ddd8bdc8e req-e18434e7-5cf7-4cc6-a386-eb2155211a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262cc35f-b67e-4036-912a-7b0bd1a890a9", "name": "network-vif-deleted", "tag": "61a6f040-769a-4c6e-a924-16e8826a4df8"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:46:12.544872 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-9053f50c-00bb-42d1-9e9a-0b2ddd8bdc8e req-e18434e7-5cf7-4cc6-a386-eb2155211a22 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:12.545351 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-9053f50c-00bb-42d1-9e9a-0b2ddd8bdc8e req-e18434e7-5cf7-4cc6-a386-eb2155211a22 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:12.545776 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-9053f50c-00bb-42d1-9e9a-0b2ddd8bdc8e req-e18434e7-5cf7-4cc6-a386-eb2155211a22 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:12.558676 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-9053f50c-00bb-42d1-9e9a-0b2ddd8bdc8e req-e18434e7-5cf7-4cc6-a386-eb2155211a22 service nova] Creating event network-vif-deleted:61a6f040-769a-4c6e-a924-16e8826a4df8 for instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 on hv-cinder-85426 Aug 29 21:46:12.563812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-9053f50c-00bb-42d1-9e9a-0b2ddd8bdc8e req-e18434e7-5cf7-4cc6-a386-eb2155211a22 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032647 Aug 29 21:46:12.564145 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 555/1149] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:46:12.867225 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:12.867872 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:12.875750 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:12.876698 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:12.877138 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:12.877853 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:12.878465 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:12.878897 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:12.952597 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:12.961531 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-0b186e75-59ac-4d1c-bad8-9c217cb5398f tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 200 len: 1225 microversion: 2.1 time: 0.098341 Aug 29 21:46:12.962134 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 595/1150] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:12 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:46:13.983910 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:13.984588 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: 262cc35f-b67e-4036-912a-7b0bd1a890a9] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:13.990933 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:13.991424 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:13.991866 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:13.992664 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:13.993129 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:13.994055 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:14.008495 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] HTTP exception thrown: Instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 could not be found. Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Request method failure captured: Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 HTTP/1.1 Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTILcjEFChxOh_8Q6iITN3-2qpffHQOIVYODTQ6gMfLKw0aEhxXZ0IsiDoTOU922WJGLW1e4927Lot-56lWXRcQJ3cw8LA3mCUShvuobThp6X1AJmc0aQlwEnNlnV0n4_MrUSP2lIs1xmBpFbQkTCOnXTc2iwgQza94PFD5RJxrol4Q Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:46:14.015188 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_77472ffae4da491881e41c08aa09e4fc", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 0d57f52dc9044a259e6acbde81ac0476 Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 could not be found. Aug 29 21:46:14.017084 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': '262cc35f-b67e-4036-912a-7b0bd1a890a9'} Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 could not be found. Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:46:14.018115 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 could not be found. Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 could not be found. Aug 29 21:46:14.019908 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:14.021421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Returning 404 to user: Instance 262cc35f-b67e-4036-912a-7b0bd1a890a9 could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:46:14.021421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2ab91df8-8d1e-4309-a327-c34c4b00cd88 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9" status: 404 len: 111 microversion: 2.1 time: 0.033275 Aug 29 21:46:14.021421 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 556/1151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:13 2022] GET /compute/v2.1/servers/262cc35f-b67e-4036-912a-7b0bd1a890a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:46:17.655320 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:17.658402 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:17.658575 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-1affb2ec-5c6b-48cb-b97c-8a57a5f3d920 req-461472ab-2325-4bef-89b7-cabaad92c55d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6eb865-157c-4fbe-ba0d-515436f70ee5", "tag": "93df90ce-afcc-473a-9691-e95cf9df4eba"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:46:17.663403 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:17.663912 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:17.664572 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:17.665545 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:17.665970 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:17.666545 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:17.668713 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-1affb2ec-5c6b-48cb-b97c-8a57a5f3d920 req-461472ab-2325-4bef-89b7-cabaad92c55d service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:17.669263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-1affb2ec-5c6b-48cb-b97c-8a57a5f3d920 req-461472ab-2325-4bef-89b7-cabaad92c55d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:17.669946 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-1affb2ec-5c6b-48cb-b97c-8a57a5f3d920 req-461472ab-2325-4bef-89b7-cabaad92c55d service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:17.684509 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-1affb2ec-5c6b-48cb-b97c-8a57a5f3d920 req-461472ab-2325-4bef-89b7-cabaad92c55d service nova] Creating event network-changed:93df90ce-afcc-473a-9691-e95cf9df4eba for instance db6eb865-157c-4fbe-ba0d-515436f70ee5 on hv-cinder-85426 Aug 29 21:46:17.689869 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-1affb2ec-5c6b-48cb-b97c-8a57a5f3d920 req-461472ab-2325-4bef-89b7-cabaad92c55d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036011 Aug 29 21:46:17.690838 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 557/1152] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:46:17.696142 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Going to try to terminate instance {{(pid=121558) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:46:18.057727 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7c449bfa-4137-4467-b568-fba73fa67f69 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "DELETE /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 204 len: 0 microversion: 2.1 time: 0.406101 Aug 29 21:46:18.063187 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 596/1153] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:46:17 2022] DELETE /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:46:18.070559 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:18.078701 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:18.085828 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:18.086415 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:18.087143 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:18.088636 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:18.089299 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:18.089899 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:18.237140 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:18.245638 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-061a212e-1907-4af9-b2e5-0c2d64ad01d0 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1578 microversion: 2.1 time: 0.181689 Aug 29 21:46:18.246210 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 558/1154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:18 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:46:19.267304 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:19.268087 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:19.275379 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:19.275854 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:19.276309 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:19.276992 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:19.277435 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:19.277857 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:19.420692 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:19.429823 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-d14be30a-f990-44c8-aa34-9d8ce71726fa tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1578 microversion: 2.1 time: 0.166734 Aug 29 21:46:19.430463 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 597/1155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:19 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:46:20.304967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [req-8d1a14ec-1ec0-404c-8f13-80c637f0aeff req-c7cdc8f8-cf25-41bf-96f7-ec54821dd5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6eb865-157c-4fbe-ba0d-515436f70ee5", "name": "network-vif-deleted", "tag": "93df90ce-afcc-473a-9691-e95cf9df4eba"}]} {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:46:20.315355 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-8d1a14ec-1ec0-404c-8f13-80c637f0aeff req-c7cdc8f8-cf25-41bf-96f7-ec54821dd5e3 service nova] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:20.316419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-8d1a14ec-1ec0-404c-8f13-80c637f0aeff req-c7cdc8f8-cf25-41bf-96f7-ec54821dd5e3 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:20.316419 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [req-8d1a14ec-1ec0-404c-8f13-80c637f0aeff req-c7cdc8f8-cf25-41bf-96f7-ec54821dd5e3 service nova] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:20.327970 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.compute.server_external_events [req-8d1a14ec-1ec0-404c-8f13-80c637f0aeff req-c7cdc8f8-cf25-41bf-96f7-ec54821dd5e3 service nova] Creating event network-vif-deleted:93df90ce-afcc-473a-9691-e95cf9df4eba for instance db6eb865-157c-4fbe-ba0d-515436f70ee5 on hv-cinder-85426 Aug 29 21:46:20.332817 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [req-8d1a14ec-1ec0-404c-8f13-80c637f0aeff req-c7cdc8f8-cf25-41bf-96f7-ec54821dd5e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031694 Aug 29 21:46:20.333406 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 559/1156] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Aug 29 21:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:46:20.452375 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:20.452921 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:20.459757 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:20.460218 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:20.460864 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:20.461363 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:20.461806 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:20.462839 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:20.532832 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.policy [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:20.541276 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-44247c5e-a96e-4736-9118-4bd49a658a70 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1226 microversion: 2.1 time: 0.092920 Aug 29 21:46:20.541967 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 598/1157] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:20 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:46:21.563110 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:21.563821 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:21.570111 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:21.570594 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:21.571035 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:21.571765 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:21.572263 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:21.572684 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:21.605567 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:21.606043 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:21.606475 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:21.606914 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.objects.instance [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lazy-loading 'fault' on Instance uuid db6eb865-157c-4fbe-ba0d-515436f70ee5 {{(pid=121559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:46:21.648836 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.policy [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d57f52dc9044a259e6acbde81ac0476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77472ffae4da491881e41c08aa09e4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121559) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:21.656763 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2dc2ffe9-d771-4e5c-b595-63715678ebe5 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 200 len: 1185 microversion: 2.1 time: 0.098526 Aug 29 21:46:21.657347 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 560/1158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:21 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 1185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:46:22.678483 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:22.679085 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: db6eb865-157c-4fbe-ba0d-515436f70ee5] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:22.687538 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:22.688045 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:22.688480 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:22.689174 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:22.689620 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:22.690037 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:22.703443 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] HTTP exception thrown: Instance db6eb865-157c-4fbe-ba0d-515436f70ee5 could not be found. Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Request method failure captured: Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 HTTP/1.1 Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTILcjEFChxOh_8Q6iITN3-2qpffHQOIVYODTQ6gMfLKw0aEhxXZ0IsiDoTOU922WJGLW1e4927Lot-56lWXRcQJ3cw8LA3mCUShvuobThp6X1AJmc0aQlwEnNlnV0n4_MrUSP2lIs1xmBpFbQkTCOnXTc2iwgQza94PFD5RJxrol4Q Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:46:22.705084 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_77472ffae4da491881e41c08aa09e4fc", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 0d57f52dc9044a259e6acbde81ac0476 Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance db6eb865-157c-4fbe-ba0d-515436f70ee5 could not be found. Aug 29 21:46:22.706788 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'db6eb865-157c-4fbe-ba0d-515436f70ee5'} Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6eb865-157c-4fbe-ba0d-515436f70ee5 could not be found. Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:46:22.708021 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6eb865-157c-4fbe-ba0d-515436f70ee5 could not be found. Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6eb865-157c-4fbe-ba0d-515436f70ee5 could not be found. Aug 29 21:46:22.709606 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:22.711431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Returning 404 to user: Instance db6eb865-157c-4fbe-ba0d-515436f70ee5 could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:46:22.711431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-706becbb-df3e-470b-979a-4baccbf93abe tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5" status: 404 len: 111 microversion: 2.1 time: 0.032005 Aug 29 21:46:22.711431 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 599/1159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:22 2022] GET /compute/v2.1/servers/db6eb865-157c-4fbe-ba0d-515436f70ee5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:46:23.247812 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:23.248477 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.compute.api [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121559) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:23.255457 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:23.255961 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:23.256392 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:23.257083 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:23.257528 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:23.257967 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG oslo_concurrency.lockutils [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:23.272192 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.wsgi [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] HTTP exception thrown: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Request method failure captured: Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: request: DELETE /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db HTTP/1.1 Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept: application/json Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Accept-Encoding: identity Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Connection: close Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Length: 0 Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Content-Type: application/json Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Host: 10.222.0.65 Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: Openstack-System-Scope: None Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: User-Agent: python-urllib3/1.26.12 Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Auth-Token: gAAAAABjDTILcjEFChxOh_8Q6iITN3-2qpffHQOIVYODTQ6gMfLKw0aEhxXZ0IsiDoTOU922WJGLW1e4927Lot-56lWXRcQJ3cw8LA3mCUShvuobThp6X1AJmc0aQlwEnNlnV0n4_MrUSP2lIs1xmBpFbQkTCOnXTc2iwgQza94PFD5RJxrol4Q Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Id: None Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Domain-Name: None Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Identity-Status: Confirmed Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Is-Admin-Project: True Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Id: default Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Domain-Name: Default Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Project-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Role: reader,member Aug 29 21:46:23.273831 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Roles: reader,member Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_77472ffae4da491881e41c08aa09e4fc", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Id: default Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Domain-Name: Default Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Id: 0d57f52dc9044a259e6acbde81ac0476 Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: X-User-Name: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: method: > Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: exception: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.276234 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: action_args: {'id': 'cdda6e45-0167-46da-96c8-2d23ee9767db'} Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:46:23.277293 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.278887 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.280660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Returning 404 to user: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. {{(pid=121559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:46:23.280660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-2c2444a4-e599-4a89-81fa-0eb42979ccf8 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 404 len: 111 microversion: 2.1 time: 0.031941 Aug 29 21:46:23.280660 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 561/1160] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Aug 29 21:46:23 2022] DELETE /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:46:23.285121 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '>' {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:23.285734 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.compute.api [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] [instance: cdda6e45-0167-46da-96c8-2d23ee9767db] Fetching instance by UUID {{(pid=121558) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:23.291808 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:23.292335 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:23.292778 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:23.293630 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Acquiring lock "d54c4588-655f-44d3-a4d7-897122969839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:23.294089 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:23.294516 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG oslo_concurrency.lockutils [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Lock "d54c4588-655f-44d3-a4d7-897122969839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:23.308952 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.wsgi [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] HTTP exception thrown: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Request method failure captured: Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: request: GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db HTTP/1.1 Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept: application/json Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Accept-Encoding: identity Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Connection: close Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Length: 0 Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Content-Type: application/json Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Host: 10.222.0.65 Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: Openstack-System-Scope: None Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: User-Agent: python-urllib3/1.26.12 Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Auth-Token: gAAAAABjDTILcjEFChxOh_8Q6iITN3-2qpffHQOIVYODTQ6gMfLKw0aEhxXZ0IsiDoTOU922WJGLW1e4927Lot-56lWXRcQJ3cw8LA3mCUShvuobThp6X1AJmc0aQlwEnNlnV0n4_MrUSP2lIs1xmBpFbQkTCOnXTc2iwgQza94PFD5RJxrol4Q Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Id: None Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Domain-Name: None Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Identity-Status: Confirmed Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Is-Admin-Project: True Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Id: default Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Domain-Name: Default Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Project-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Role: reader,member Aug 29 21:46:23.310591 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Roles: reader,member Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_77472ffae4da491881e41c08aa09e4fc", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/77472ffae4da491881e41c08aa09e4fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Id: 77472ffae4da491881e41c08aa09e4fc Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-Tenant-Name: tempest-TestVolumeBootPattern-2048158562 Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Id: default Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Domain-Name: Default Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Id: 0d57f52dc9044a259e6acbde81ac0476 Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: X-User-Name: tempest-TestVolumeBootPattern-2048158562-project Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: method: > Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: exception: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.312436 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: action_args: {'id': 'cdda6e45-0167-46da-96c8-2d23ee9767db'} Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: {{(pid=121558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:46:23.313425 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. Aug 29 21:46:23.314963 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: ERROR nova.api.openstack.wsgi Aug 29 21:46:23.316401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: DEBUG nova.api.openstack.wsgi [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Returning 404 to user: Instance cdda6e45-0167-46da-96c8-2d23ee9767db could not be found. {{(pid=121558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:46:23.316401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: INFO nova.api.openstack.requestlog [None req-7f2533f4-badf-45e1-beaa-8d86ed322647 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db" status: 404 len: 111 microversion: 2.1 time: 0.030862 Aug 29 21:46:23.316401 dv-cinder-854264-2-iscsi devstack@n-api.service[121558]: [pid: 121558|app: 0|req: 600/1161] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:23 2022] GET /compute/v2.1/servers/cdda6e45-0167-46da-96c8-2d23ee9767db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:46:24.844514 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: DEBUG nova.api.openstack.wsgi [None req-67182ef9-d43d-4936-9b12-b47c444eb193 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] Calling method '.version_select at 0x7fc843ade700>' {{(pid=121559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:24.944900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: INFO nova.api.openstack.requestlog [None req-67182ef9-d43d-4936-9b12-b47c444eb193 tempest-TestVolumeBootPattern-2048158562 tempest-TestVolumeBootPattern-2048158562-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1734531656" status: 202 len: 0 microversion: 2.1 time: 0.102497 Aug 29 21:46:24.944900 dv-cinder-854264-2-iscsi devstack@n-api.service[121559]: [pid: 121559|app: 0|req: 562/1162] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Aug 29 21:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1734531656 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)